-- Logs begin at Tue 2022-08-02 07:39:59 UTC, end at Tue 2022-08-02 08:33:00 UTC. -- Aug 02 08:08:43.928276 dv-cinder-850318-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 02 08:08:43.936885 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 08:08:43 2022] *** Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: nodename: dv-cinder-850318-5-iscsi Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: machine: x86_64 Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: clock source: unix Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: pcre jit disabled Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: detected number of CPU cores: 4 Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: current working directory: / Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: detected binary path: /usr/bin/uwsgi-core Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: your processes number limit is 47680 Aug 02 08:08:43.938969 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: your memory page size is 4096 bytes Aug 02 08:08:43.939589 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: detected max file descriptor number: 2048 Aug 02 08:08:43.939589 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: lock engine: pthread robust mutexes Aug 02 08:08:43.939589 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: thunder lock: enabled Aug 02 08:08:43.939589 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 02 08:08:43.939589 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 08:08:43.978189 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: Python main interpreter initialized at 0x55ca1d6e39c0 Aug 02 08:08:43.978189 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: python threads support enabled Aug 02 08:08:43.978189 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: your server socket listen backlog is limited to 100 connections Aug 02 08:08:43.978189 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: your mercy for graceful operations on workers is 90 seconds Aug 02 08:08:43.978583 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 08:08:43.978655 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: *** Operational MODE: preforking *** Aug 02 08:08:43.978887 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: *** uWSGI is running in multiple interpreter mode *** Aug 02 08:08:43.978887 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: spawned uWSGI master process (pid: 80171) Aug 02 08:08:43.979088 dv-cinder-850318-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 02 08:08:43.980527 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: spawned uWSGI worker 1 (pid: 80183, cores: 1) Aug 02 08:08:43.980527 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: spawned uWSGI worker 2 (pid: 80184, cores: 1) Aug 02 08:08:43.980527 dv-cinder-850318-5-iscsi devstack@keystone.service[80171]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 08:08:49.487770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:08:49.487770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: from cryptography.utils import int_from_bytes Aug 02 08:08:49.488571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:08:49.488571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: from cryptography.utils import int_from_bytes Aug 02 08:08:49.488999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:08:49.488999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: from cryptography.utils import int_from_bytes Aug 02 08:08:49.489106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 08:08:49.489106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: from cryptography.utils import int_from_bytes Aug 02 08:08:49.539523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:08:49.539712 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:08:49.539887 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] command line args: [] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:08:49.540153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:08:49.540331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ================================================================================ {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:08:49.540606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] admin_token = **** {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.540833 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] config_dir = [] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.541021 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.541206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] config_source = [] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.541643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] debug = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.541842 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.542283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.542427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.542668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.542915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.543144 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] list_limit = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.543324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] log_config_append = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.543503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.543682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] log_dir = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.543859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] log_file = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.544092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.544338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.544583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.544830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.545008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.545184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.545427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.545671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.545904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.546160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.546392 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.546623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.546712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 08:08:49.546856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 08:08:49.546943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.547039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] command line args: [] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 08:08:49.547115 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.547318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 08:08:49.547389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.547796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ================================================================================ {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 08:08:49.547796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] admin_token = **** {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.549270 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.549550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] config_dir = [] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.549639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] publish_errors = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.549714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.549956 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] config_source = [] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] debug = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550267 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] standard_threads = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550664 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550788 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.550962 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] list_limit = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] use_journal = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] log_config_append = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] use_json = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551310 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] use_stderr = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] use_syslog = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] log_dir = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] log_file = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551586 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551648 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551711 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.551774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.551839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.552003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.552080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.552218 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.552348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.552551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.552688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.552825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.552935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.553065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.553205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.553334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.553427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.553504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.553582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.553714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.553792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.553915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.554091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.554190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.554266 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.554358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.554432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.554567 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.554645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.554781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.554862 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.555027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.555263 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.555342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.555475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] publish_errors = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.555561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.555711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.555826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.555951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.556036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.556166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.556274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.556375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.556454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.556612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.556690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.556849 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] standard_threads = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.556941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.557083 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.557162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.557327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.557417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.557491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.557572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.557670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] use_journal = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.557803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.557883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] use_json = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.558068 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] use_stderr = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.558163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.558247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] use_syslog = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.558320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.558434 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 08:08:49.558514 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.558695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.558774 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.558926 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.559001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.559186 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.559271 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.559429 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.559507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.559666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.559747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.559905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.559982 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.560133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.560217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.560370 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.560450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.560606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.560691 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.560836 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.560915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.561066 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.561149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.561279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.561357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.561510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.561596 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.561745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.561826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.561992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.562092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.562252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.562331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.562490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.562573 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.562721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.562800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.562958 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.563054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.563193 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.563276 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.563440 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.563519 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.563672 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.563759 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.564450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.564544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.564697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.564776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.564933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.565090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.565166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.565238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.565390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.565469 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.565618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.565710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.565867 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.565946 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.566117 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.566197 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.566351 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.566443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.566581 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.566667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.566832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.566912 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.567065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.567150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.567296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.567407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.567530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.567637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.567765 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.567880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.568004 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.568116 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.568245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.568352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.568482 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.568595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.568732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.568822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.568943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.569019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.569158 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.569249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.569387 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.569467 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.569625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.569709 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.569859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.569950 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.570120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.570206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.570360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.570486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.570593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.570702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.570827 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.570909 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.571044 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.571163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.571280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.571414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.571503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.571578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.571751 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.571894 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.572021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.572154 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.572267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.572401 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.572501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.572643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.572732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.572886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.572980 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.573126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.573207 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.573364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.573450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.573596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.573687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.573828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.573907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.574083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.574166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.574318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.574410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.574554 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.574640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.574784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.574864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.575022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.575110 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.575257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.575335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.575506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.575584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.575743 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.575830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.575992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.576070 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.576231 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.576313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.576470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.576626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.576702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] auth.external = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.576772 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.576917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.576995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.577168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.577264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.577408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.577489 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.577654 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.577733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] auth.password = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.577893 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.577974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] auth.token = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.578157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.578249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.578390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.578458 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.578626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.578724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.578852 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.578923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.579100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.579202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.579342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.579419 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.579604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.579704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.579839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] credential.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.579958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.580085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.580340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.580340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.580500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.580575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.580647 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.580787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.580896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.581024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.581107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.581254 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.581335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.581475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.581554 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.581710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.581791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.581943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.582047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.582213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.582295 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.582454 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.582537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.582706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.582788 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.582947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.583035 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.583209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.583290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.583474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.583557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.583720 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.583807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] federation.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.583956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] auth.external = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.584036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.584190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.584272 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.584434 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.584521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.584668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.584751 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.584915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.585010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] auth.password = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.585154 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.585242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] auth.token = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.585394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.585475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.585633 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.585717 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.585883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.585963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.586142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.586225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.586396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.586482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.586647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.586728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.586883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.586964 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.587122 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] credential.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.587205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.587373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.587454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.587618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.587698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.587869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.587952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.588098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.588187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.588335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.588416 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.588571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.588653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.588834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.588941 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.589063 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.589154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.589295 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.589384 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.589527 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.589615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.589772 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.589852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.590040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.590125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.590287 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.590378 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.590544 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.590703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.590781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.590853 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.591049 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.591131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] federation.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.591287 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.591393 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.591521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.591600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.591752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.591831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.591989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.592078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.592306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.592462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.592582 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.592703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.592791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.592942 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.593022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.593188 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.593268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.593422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.593523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.593667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.593754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.593908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.593988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.594179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.594280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.594424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.594508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.594665 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.594744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.594894 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.594981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.595157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.595237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.595390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.595472 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.595626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.595714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.595861 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.595950 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.596102 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.596183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.596338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.596431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.596571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.596650 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.596807 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.596886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.597051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.597142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.597283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.597364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.597513 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.597592 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.597761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.597851 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.598059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.598144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.598264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.598355 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.598784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.598884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.599021 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.599102 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.599254 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.599342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.599490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.599590 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.599725 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.599805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.600040 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.600145 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.600341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.600439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.600517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.600598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.600662 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.600721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.601356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.601464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.601544 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.601607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.601667 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.601725 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.601831 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.601915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.602062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.602167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.602167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.602377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.602475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.602558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.602622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.602681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.602773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.602846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.603021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.603175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.603306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.603440 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.603593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.603735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.603882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.604011 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.604143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.604283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.604425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.604565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.604658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.604741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.604888 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.605013 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.605138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.605267 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.605414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.605545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.605676 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.605804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.605931 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.606084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.606219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.606350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.606483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.606606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.606736 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.606865 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.607001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.607141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.607276 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.607413 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.607542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.607670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.607809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.607989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.608130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.608258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.608386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.608514 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.608648 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.608780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] resource.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.608910 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.609064 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.609201 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.609330 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.609424 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.609506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.609622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.609753 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.609914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.610057 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.610193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.610277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.610443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.610568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.611186 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.611325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.611459 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.611590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.611716 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.611851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] role.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.611979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] role.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.612280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.612406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.612536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.612665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.612794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.612923 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.613072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.613222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.613378 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.613571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.613700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.613856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.613997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.614202 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.614333 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.614462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.614591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.614591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.614844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.614844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.615042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.615106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.615165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.615165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.615445 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.615445 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.615639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.615717 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.615789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.615789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.615930 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616216 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616299 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] resource.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616587 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616741 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.616957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617323 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617666 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] role.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.617926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.618095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] role.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.618278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.618371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.618529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.618610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.618766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.618846 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.619003 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.619091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.619235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.619316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.619470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] token.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.619554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.619707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.619796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.619955 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.620041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.620193 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.620273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.620447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.620537 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.620694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.620775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.620933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.621013 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.621178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.621270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.621420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.621502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.621666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.621857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.621939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.622125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.622243 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.622375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.622509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.622614 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.622703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.622838 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.622938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.623067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.623150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.623306 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.623396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.623565 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.623645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.623820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.623901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.connection = **** {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.624065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.624170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.624300 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.624390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.624535 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.624616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.624767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.624853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.624998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.625090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.625232 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.625314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.625466 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.625552 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.625700 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.625790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.625944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.626044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.626204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.626286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.626985 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.627086 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] token.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.627222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.627304 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.627468 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.627549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.627703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.627793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.627945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.628026 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.628173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.628254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.628411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.628510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.628644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.628726 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.628799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:08:49.628894 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.629145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.629387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.629629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.629867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.630145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.630400 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.630635 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.630882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.631183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.631450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.connection = **** {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.631700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.631952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.632230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.632471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.632711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.632952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.633268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.633432 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.633678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.633917 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.634187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.634426 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.634676 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.634914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.635164 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.635396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.635638 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.635873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 08:08:49.636046 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 08:08:49.658604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.658802 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.659028 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.661464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.661701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.661933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.667725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.670631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.698196 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.698435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.698906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.699145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.751568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.752294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.803763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.803971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.804462 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.804704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.870235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.870407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.870487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.870594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.870678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.870814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.870897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.871033 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.871116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.871250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.871500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.895004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.895269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.895498 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.895621 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.895778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.895897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.896020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.896143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.896262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.896393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.896518 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.896637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.896637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.896860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.908835 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.909030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.922614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.922808 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.922884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.923031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.923150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.923841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.923937 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.924094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.924179 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.924306 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.924391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.924514 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.924593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80183) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.924715 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80184) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 08:08:49.941784 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.941939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.942052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:08:49.942177 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:08:49.942346 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.942514 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.942616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:08:49.942717 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 08:08:49.942799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.942986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.943067 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.943247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.943331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.943506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.943587 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.943759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.953187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.953345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.953465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.953620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.953734 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.953885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.954037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.954187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.960970 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:49.961189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:49.966049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:49.966247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:49.966345 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.966509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.966602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.966794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.966882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.967077 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.967162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.967360 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.967448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.967618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.967710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.967884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.967970 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.968157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.968253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.968426 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.968514 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.968690 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.968775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.968951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.992782 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.993939 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.994276 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:49.994555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.995459 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:49.995742 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.999136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:49.999416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:49.999695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.000382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.000666 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.000952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.006386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.006669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.010437 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.010768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.010857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.011053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.011341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.011621 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.011895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.012175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.012444 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.012728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.015610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.015895 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.016182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.016466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.016743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.017084 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.017374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.017675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.028669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.028961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.033422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.034281 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.034563 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.036683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.036984 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.038496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.041607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.041973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.042288 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.044869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.046681 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.048045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.049040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.049324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.049623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.049901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.050216 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.050495 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.053637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.053932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.054243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.054531 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.054811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.055115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.066062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.066345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.066613 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.066875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.071143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.071424 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.071693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.071958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.073696 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.075262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.075534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.078363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.078644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.078874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.079021 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.079207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.080008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.080952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.081228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.084082 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.084364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.084661 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.084946 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.085237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.091450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.091740 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.092017 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.092292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.092565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.092834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.093115 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.097412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.097703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.097987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.098299 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.098583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.098861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.099142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.109202 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.112182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.114764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.115137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.117722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.117831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.119290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.119576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.119856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.120733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.123321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.124959 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.125259 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.125542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.126378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.127969 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.130894 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.131182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.131465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.131741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.132061 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.133659 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.136591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.136882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.137177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.137452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.139727 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.140017 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.140298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.146045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.146326 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.146607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.147613 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80184) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.147895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.148174 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.148457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.148730 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.149008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.149283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.149571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.149968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.150276 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.150557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.150819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.151091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.151348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80184) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.153552 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80183) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 08:08:50.153841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.154150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.154427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.154710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.154985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.155268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.155538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.155917 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.156202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.156486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.156758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.157038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.157301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80183) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 08:08:50.185693 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ca1d6e39c0 pid: 80184 (default app) Aug 02 08:08:50.189137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda575a4-8675-4a5a-845e-1f092f50c6ee None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:08:50.189425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda575a4-8675-4a5a-845e-1f092f50c6ee None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:08:50.189698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda575a4-8675-4a5a-845e-1f092f50c6ee None None] PATH_INFO: `/v3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:08:50.191459 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ca1d6e39c0 pid: 80183 (default app) Aug 02 08:08:50.194026 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Tue Aug 2 08:08:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:08:57.880578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af7ee9-73b0-44bf-b581-862e346a0714 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:08:57.881139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af7ee9-73b0-44bf-b581-862e346a0714 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:08:57.881139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af7ee9-73b0-44bf-b581-862e346a0714 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:08:57.885649 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:08:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:08:57.891278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef86d-35d7-432f-9bcb-b30f92d59c75 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:08:57.891730 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef86d-35d7-432f-9bcb-b30f92d59c75 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:08:57.891827 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef86d-35d7-432f-9bcb-b30f92d59c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:08:57.961766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: INFO dbcounter [None req-3e9ef86d-35d7-432f-9bcb-b30f92d59c75 None None] Registered counter for database keystone Aug 02 08:08:57.981838 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG oslo_db.sqlalchemy.engines [None req-3e9ef86d-35d7-432f-9bcb-b30f92d59c75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:08:57.988859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writer thread running {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:08:58.169023 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG passlib.handlers.bcrypt [None req-3e9ef86d-35d7-432f-9bcb-b30f92d59c75 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80184) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 08:08:58.169346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG passlib.handlers.bcrypt [None req-3e9ef86d-35d7-432f-9bcb-b30f92d59c75 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80184) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 08:08:58.224155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-3e9ef86d-35d7-432f-9bcb-b30f92d59c75 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:08:58.225785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3e9ef86d-35d7-432f-9bcb-b30f92d59c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:08:58.359683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:08:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 02 08:08:58.507835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af7ee9-73b0-44bf-b581-862e346a0714 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:08:58.577328 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: INFO dbcounter [None req-47af7ee9-73b0-44bf-b581-862e346a0714 None None] Registered counter for database keystone Aug 02 08:08:58.599626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG oslo_db.sqlalchemy.engines [None req-47af7ee9-73b0-44bf-b581-862e346a0714 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 08:08:58.606068 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writer thread running {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 08:08:58.727951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af7ee9-73b0-44bf-b581-862e346a0714 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:08:58.732267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba60d11-dcc9-4f39-a280-067b7c3c62cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:08:58.732904 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60d11-dcc9-4f39-a280-067b7c3c62cb admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:08:58.733184 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60d11-dcc9-4f39-a280-067b7c3c62cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:08:58.733456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60d11-dcc9-4f39-a280-067b7c3c62cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:08:58.742179 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba60d11-dcc9-4f39-a280-067b7c3c62cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:08:58.794381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7ba60d11-dcc9-4f39-a280-067b7c3c62cb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 08:08:58.794663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba60d11-dcc9-4f39-a280-067b7c3c62cb admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:08:58.804308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Tue Aug 2 08:08:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:08:58.810526 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef86d-35d7-432f-9bcb-b30f92d59c75 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:08:58.825435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef86d-35d7-432f-9bcb-b30f92d59c75 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:08:58.830540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb74e4-6bf6-40ea-bde2-1184e9a5cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:08:58.831658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb74e4-6bf6-40ea-bde2-1184e9a5cd3d admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:08:58.831945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb74e4-6bf6-40ea-bde2-1184e9a5cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:08:58.832220 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb74e4-6bf6-40ea-bde2-1184e9a5cd3d admin admin] PATH_INFO: `/v3/projects/255cf96e6d4c4f0180d3f193cc9e8b40` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:08:58.833745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb74e4-6bf6-40ea-bde2-1184e9a5cd3d admin admin] RBAC: Authorizing `identity:get_project(project_id=255cf96e6d4c4f0180d3f193cc9e8b40)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:08:58.883595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: WARNING keystone.common.rbac_enforcer.enforcer [None req-85eb74e4-6bf6-40ea-bde2-1184e9a5cd3d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 08:08:58.883946 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb74e4-6bf6-40ea-bde2-1184e9a5cd3d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:08:58.888604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Tue Aug 2 08:08:58 2022] GET /identity/v3/projects/255cf96e6d4c4f0180d3f193cc9e8b40 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:00.927928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40085588-30f1-436b-b4fd-6a3cda8fc9ac None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:00.928493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40085588-30f1-436b-b4fd-6a3cda8fc9ac None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:00.928493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40085588-30f1-436b-b4fd-6a3cda8fc9ac None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:00.932636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:00.938257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02480905-a52f-485b-be59-8002e0faac0f None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:00.939222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02480905-a52f-485b-be59-8002e0faac0f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:00.939353 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02480905-a52f-485b-be59-8002e0faac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:00.964885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-02480905-a52f-485b-be59-8002e0faac0f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:00.966473 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-02480905-a52f-485b-be59-8002e0faac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:00.974630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 02 08:09:00.997566 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40085588-30f1-436b-b4fd-6a3cda8fc9ac None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:01.012219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40085588-30f1-436b-b4fd-6a3cda8fc9ac None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:01.016410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a89f-70a5-4c34-a020-dd5e7fb65d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:01.017659 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a89f-70a5-4c34-a020-dd5e7fb65d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:01.017940 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a89f-70a5-4c34-a020-dd5e7fb65d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:01.018242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a89f-70a5-4c34-a020-dd5e7fb65d03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:01.026863 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5a89f-70a5-4c34-a020-dd5e7fb65d03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:01.028634 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5a89f-70a5-4c34-a020-dd5e7fb65d03 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:01.038033 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Tue Aug 2 08:09:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:09:01.044228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02480905-a52f-485b-be59-8002e0faac0f None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:01.056239 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02480905-a52f-485b-be59-8002e0faac0f None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:01.061624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0713a-982f-472f-956c-a5f805756ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:01.062319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0713a-982f-472f-956c-a5f805756ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:01.062606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0713a-982f-472f-956c-a5f805756ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:01.062886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0713a-982f-472f-956c-a5f805756ae7 admin admin] PATH_INFO: `/v3/users/48e73f0688f64fae87f2adc4e4e25455` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:01.064806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0713a-982f-472f-956c-a5f805756ae7 admin admin] RBAC: Authorizing `identity:get_user(user_id=48e73f0688f64fae87f2adc4e4e25455)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:01.066807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0713a-982f-472f-956c-a5f805756ae7 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:01.068524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Tue Aug 2 08:09:01 2022] GET /identity/v3/users/48e73f0688f64fae87f2adc4e4e25455 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:03.238224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e983-d91d-4256-a557-dba688f2c6a6 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:03.238797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e983-d91d-4256-a557-dba688f2c6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:03.238797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0e983-d91d-4256-a557-dba688f2c6a6 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:03.240219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:03.245937 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fec8ff-acc9-42d7-af4f-d7f8566b6ac7 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:03.246497 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fec8ff-acc9-42d7-af4f-d7f8566b6ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:03.246740 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fec8ff-acc9-42d7-af4f-d7f8566b6ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:03.267011 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-b4fec8ff-acc9-42d7-af4f-d7f8566b6ac7 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:03.268398 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b4fec8ff-acc9-42d7-af4f-d7f8566b6ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:03.324614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc504e-487d-4fd3-a817-4f01ffbdf1e0 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:03.324880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc504e-487d-4fd3-a817-4f01ffbdf1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:03.325163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc504e-487d-4fd3-a817-4f01ffbdf1e0 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:03.326582 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:09:03.332094 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba394449-e467-4987-bec0-c288c90b4074 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:03.332382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba394449-e467-4987-bec0-c288c90b4074 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:03.332668 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba394449-e467-4987-bec0-c288c90b4074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:03.366568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:03.383785 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG passlib.handlers.bcrypt [None req-ba394449-e467-4987-bec0-c288c90b4074 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80183) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 08:09:03.384218 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG passlib.handlers.bcrypt [None req-ba394449-e467-4987-bec0-c288c90b4074 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80183) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 08:09:03.390984 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fec8ff-acc9-42d7-af4f-d7f8566b6ac7 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:03.416927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:03.430946 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-ba394449-e467-4987-bec0-c288c90b4074 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:03.432640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ba394449-e467-4987-bec0-c288c90b4074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:03.517972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fec8ff-acc9-42d7-af4f-d7f8566b6ac7 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:03.546507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:03.554666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb93475-e8f0-4c1d-be21-dfe187d75e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:03.555422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb93475-e8f0-4c1d-be21-dfe187d75e65 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:03.555737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb93475-e8f0-4c1d-be21-dfe187d75e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:03.556054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb93475-e8f0-4c1d-be21-dfe187d75e65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:03.568507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb93475-e8f0-4c1d-be21-dfe187d75e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:03.569532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba394449-e467-4987-bec0-c288c90b4074 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-0bb93475-e8f0-4c1d-be21-dfe187d75e65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:03.579975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:03.581483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:03.582561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:09:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:03.587867 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb93475-e8f0-4c1d-be21-dfe187d75e65 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:03.681299 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:03.693373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba394449-e467-4987-bec0-c288c90b4074 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:03.699322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:03.706117 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb93475-e8f0-4c1d-be21-dfe187d75e65 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:03.740047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfab23-9a13-469c-b337-6b01649e534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:03.740941 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfab23-9a13-469c-b337-6b01649e534a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:03.741226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfab23-9a13-469c-b337-6b01649e534a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:03.741499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfab23-9a13-469c-b337-6b01649e534a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:03.742354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08f2f3-12e3-4320-9a20-25174ce50b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:03.742978 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08f2f3-12e3-4320-9a20-25174ce50b8d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:03.743265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08f2f3-12e3-4320-9a20-25174ce50b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:03.743546 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08f2f3-12e3-4320-9a20-25174ce50b8d None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:03.744336 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08f2f3-12e3-4320-9a20-25174ce50b8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:03.746206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08f2f3-12e3-4320-9a20-25174ce50b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:03.746206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08f2f3-12e3-4320-9a20-25174ce50b8d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:03.758941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 8/15] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:03.764754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08f2f3-12e3-4320-9a20-25174ce50b8d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:03.813160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfab23-9a13-469c-b337-6b01649e534a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:03.814629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfab23-9a13-469c-b337-6b01649e534a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:03.883516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08f2f3-12e3-4320-9a20-25174ce50b8d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:03.945708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:09:03.951833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfab23-9a13-469c-b337-6b01649e534a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:03.955729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:04.035543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34047808-3b3b-4a60-b7ff-dab5434da3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:04.036248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34047808-3b3b-4a60-b7ff-dab5434da3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:04.036554 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34047808-3b3b-4a60-b7ff-dab5434da3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:04.036880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34047808-3b3b-4a60-b7ff-dab5434da3a1 None admin] PATH_INFO: `/v3/users/48e73f0688f64fae87f2adc4e4e25455` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:04.038204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34047808-3b3b-4a60-b7ff-dab5434da3a1 None admin] RBAC: Authorizing `identity:get_user(user_id=48e73f0688f64fae87f2adc4e4e25455)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:04.039951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34047808-3b3b-4a60-b7ff-dab5434da3a1 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:04.041985 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:03 2022] GET /identity/v3/users/48e73f0688f64fae87f2adc4e4e25455 => generated 247 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:04.048801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34047808-3b3b-4a60-b7ff-dab5434da3a1 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:04.065746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:04.069324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfab23-9a13-469c-b337-6b01649e534a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:04.110064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad3b22-64d7-4f47-9b02-1606fa35bc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:04.110979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3b22-64d7-4f47-9b02-1606fa35bc27 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:04.111263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3b22-64d7-4f47-9b02-1606fa35bc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:04.111570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad3b22-64d7-4f47-9b02-1606fa35bc27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:04.131703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad3b22-64d7-4f47-9b02-1606fa35bc27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:04.133188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad3b22-64d7-4f47-9b02-1606fa35bc27 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-adad3b22-64d7-4f47-9b02-1606fa35bc27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:09:04.153140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:04.154339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:04.155799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:09:04.155799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:09:04.155799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:09:04.155799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:04.155799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 9/18] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:04.161875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad3b22-64d7-4f47-9b02-1606fa35bc27 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:04.167727 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34047808-3b3b-4a60-b7ff-dab5434da3a1 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:04.205123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72334283-56f0-4591-b7e9-d7aeae1a2d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:04.205774 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334283-56f0-4591-b7e9-d7aeae1a2d15 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:04.206081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334283-56f0-4591-b7e9-d7aeae1a2d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:04.206361 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334283-56f0-4591-b7e9-d7aeae1a2d15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:04.207632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72334283-56f0-4591-b7e9-d7aeae1a2d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:04.209112 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72334283-56f0-4591-b7e9-d7aeae1a2d15 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:04.210824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 10/19] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:04.216503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72334283-56f0-4591-b7e9-d7aeae1a2d15 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:04.225652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:04.273840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad3b22-64d7-4f47-9b02-1606fa35bc27 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:04.304764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:04.309833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccb872-3268-4d04-a9a5-5e2e21469f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:04.310503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccb872-3268-4d04-a9a5-5e2e21469f81 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:04.310795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccb872-3268-4d04-a9a5-5e2e21469f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:04.311095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccb872-3268-4d04-a9a5-5e2e21469f81 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:04.311752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccb872-3268-4d04-a9a5-5e2e21469f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:04.312058 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccb872-3268-4d04-a9a5-5e2e21469f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:04.313443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccb872-3268-4d04-a9a5-5e2e21469f81 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:04.328787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72334283-56f0-4591-b7e9-d7aeae1a2d15 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:04.332906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 10/20] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:04.368460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89071d5c-2a0a-4f46-a259-8dcbf8cc6003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:04.369108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071d5c-2a0a-4f46-a259-8dcbf8cc6003 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:04.369397 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071d5c-2a0a-4f46-a259-8dcbf8cc6003 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:04.369680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071d5c-2a0a-4f46-a259-8dcbf8cc6003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:04.371157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89071d5c-2a0a-4f46-a259-8dcbf8cc6003 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.domain.id=default, user.id=48e73f0688f64fae87f2adc4e4e25455) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:04.371157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89071d5c-2a0a-4f46-a259-8dcbf8cc6003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:04.372400 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89071d5c-2a0a-4f46-a259-8dcbf8cc6003 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:04.380786 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 11/21] 10.222.0.57 () {56 vars in 1322 bytes} [Tue Aug 2 08:09:04 2022] GET /identity/v3/role_assignments?user.id=48e73f0688f64fae87f2adc4e4e25455&scope.domain.id=default&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:06.734622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96449-11cb-4b5a-8b67-74d35d5b97e4 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:06.736234 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96449-11cb-4b5a-8b67-74d35d5b97e4 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:06.736725 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e96449-11cb-4b5a-8b67-74d35d5b97e4 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:06.738408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 11/22] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:09:06.744260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51659b0-0845-4f31-b035-382cd0c3033f None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:06.745232 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51659b0-0845-4f31-b035-382cd0c3033f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:06.745713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51659b0-0845-4f31-b035-382cd0c3033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:06.774721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-f51659b0-0845-4f31-b035-382cd0c3033f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:06.776385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f51659b0-0845-4f31-b035-382cd0c3033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:06.869866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 12/23] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:06.906659 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e96449-11cb-4b5a-8b67-74d35d5b97e4 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:07.083446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e96449-11cb-4b5a-8b67-74d35d5b97e4 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:07.109055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:07.134629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32abb-cffd-4b73-813e-6c4a1b3cfec9 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:07.135275 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32abb-cffd-4b73-813e-6c4a1b3cfec9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:07.135783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32abb-cffd-4b73-813e-6c4a1b3cfec9 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:07.137601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:07.142819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8990a0a-c739-4d5f-aadd-caeb8bc9eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:07.143832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990a0a-c739-4d5f-aadd-caeb8bc9eba0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:07.144436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990a0a-c739-4d5f-aadd-caeb8bc9eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:07.144910 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990a0a-c739-4d5f-aadd-caeb8bc9eba0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:07.146766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38e8b-81f1-4e4d-a08b-fac02c317f22 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:07.147163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38e8b-81f1-4e4d-a08b-fac02c317f22 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:07.147544 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38e8b-81f1-4e4d-a08b-fac02c317f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:07.193600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8990a0a-c739-4d5f-aadd-caeb8bc9eba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:07.203179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d6b38e8b-81f1-4e4d-a08b-fac02c317f22 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:07.205030 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d6b38e8b-81f1-4e4d-a08b-fac02c317f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-f8990a0a-c739-4d5f-aadd-caeb8bc9eba0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:07.215522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:07.217002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:07.217757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 12/25] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:07.227491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad48a12-beb5-4c6d-8bef-ea405d6752ba None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:07.227890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad48a12-beb5-4c6d-8bef-ea405d6752ba None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:07.228275 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad48a12-beb5-4c6d-8bef-ea405d6752ba None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:07.230495 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 13/26] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:07 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:07.231791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad48a12-beb5-4c6d-8bef-ea405d6752ba None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:07.340821 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 14/27] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:07.342307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396cdbd-546d-4299-b4aa-6c2b0e18583a None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:07.342601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396cdbd-546d-4299-b4aa-6c2b0e18583a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:07.342880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396cdbd-546d-4299-b4aa-6c2b0e18583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:07.366040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:07.367811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad48a12-beb5-4c6d-8bef-ea405d6752ba None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:07.389629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-5396cdbd-546d-4299-b4aa-6c2b0e18583a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:07.391445 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5396cdbd-546d-4299-b4aa-6c2b0e18583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:07.412046 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe2391-d4c6-4d94-9a18-8d437182f166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:07.412984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe2391-d4c6-4d94-9a18-8d437182f166 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:07.413442 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe2391-d4c6-4d94-9a18-8d437182f166 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:07.413890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe2391-d4c6-4d94-9a18-8d437182f166 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:07.414882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe2391-d4c6-4d94-9a18-8d437182f166 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:07.415404 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe2391-d4c6-4d94-9a18-8d437182f166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:07.417495 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe2391-d4c6-4d94-9a18-8d437182f166 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:07.435691 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 14/28] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:07.442040 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe2391-d4c6-4d94-9a18-8d437182f166 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:07.603404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 15/29] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:07.604203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396cdbd-546d-4299-b4aa-6c2b0e18583a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:07.611072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:07.712579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe2391-d4c6-4d94-9a18-8d437182f166 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:07.760379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396cdbd-546d-4299-b4aa-6c2b0e18583a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:07.761059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2d754-c531-4b82-a2f8-81fbef4d53b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:07.761606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d754-c531-4b82-a2f8-81fbef4d53b0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:07.761920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d754-c531-4b82-a2f8-81fbef4d53b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:07.762530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d754-c531-4b82-a2f8-81fbef4d53b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:07.777876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2d754-c531-4b82-a2f8-81fbef4d53b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:07.780270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2d754-c531-4b82-a2f8-81fbef4d53b0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:07.802475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d3a5f-a3e0-4b4a-8320-f05b9ce13d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-2db2d754-c531-4b82-a2f8-81fbef4d53b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:09:07.802710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:07.803443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:07.805213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:09:07.805213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:09:07.805213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:09:07.805213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:07.805787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d3a5f-a3e0-4b4a-8320-f05b9ce13d4d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:07.805787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d3a5f-a3e0-4b4a-8320-f05b9ce13d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:07.805787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d3a5f-a3e0-4b4a-8320-f05b9ce13d4d None admin] PATH_INFO: `/v3/users/48e73f0688f64fae87f2adc4e4e25455` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:07.806265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 15/30] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:07.806265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f080de-57e4-476f-b1e9-8cb053bc0501 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:07.806530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d3a5f-a3e0-4b4a-8320-f05b9ce13d4d None admin] RBAC: Authorizing `identity:get_user(user_id=48e73f0688f64fae87f2adc4e4e25455)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:07.806674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f080de-57e4-476f-b1e9-8cb053bc0501 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:07.806674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f080de-57e4-476f-b1e9-8cb053bc0501 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:07.810409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d3a5f-a3e0-4b4a-8320-f05b9ce13d4d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:07.810409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 16/31] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:07 2022] GET /identity/v3/users/48e73f0688f64fae87f2adc4e4e25455 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:07.810409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d3a5f-a3e0-4b4a-8320-f05b9ce13d4d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:07.812446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 16/32] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:07.813261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f080de-57e4-476f-b1e9-8cb053bc0501 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:07.817646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:07.939930 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:07.951981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d3a5f-a3e0-4b4a-8320-f05b9ce13d4d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:07.956817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f080de-57e4-476f-b1e9-8cb053bc0501 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:07.995094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913a380-a80a-4601-b549-4471db8d34e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:07.995945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913a380-a80a-4601-b549-4471db8d34e5 None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:07.996386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913a380-a80a-4601-b549-4471db8d34e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:07.996762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913a380-a80a-4601-b549-4471db8d34e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:07.997701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913a380-a80a-4601-b549-4471db8d34e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:07.999191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913a380-a80a-4601-b549-4471db8d34e5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:08.014331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836594a5-86fd-4bae-854a-d5cd7496333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:08.015792 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836594a5-86fd-4bae-854a-d5cd7496333a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:08.016748 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836594a5-86fd-4bae-854a-d5cd7496333a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:08.017493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836594a5-86fd-4bae-854a-d5cd7496333a None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:08.018942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836594a5-86fd-4bae-854a-d5cd7496333a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:08.019466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836594a5-86fd-4bae-854a-d5cd7496333a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:08.021102 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836594a5-86fd-4bae-854a-d5cd7496333a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:08.037463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 17/33] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:08.039568 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836594a5-86fd-4bae-854a-d5cd7496333a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:08.161662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836594a5-86fd-4bae-854a-d5cd7496333a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:08.175185 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 17/34] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 2 08:09:07 2022] POST /identity/v3/roles => generated 219 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:08.178072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2354-4f58-4b15-9a58-7b81c7c5b8dc None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:08.178306 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2354-4f58-4b15-9a58-7b81c7c5b8dc None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:08.178742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2354-4f58-4b15-9a58-7b81c7c5b8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:08.202736 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd368b11-a516-418f-9795-e6d3326899c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:08.203786 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368b11-a516-418f-9795-e6d3326899c6 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:08.204873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368b11-a516-418f-9795-e6d3326899c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:08.205443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368b11-a516-418f-9795-e6d3326899c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:08.207331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd368b11-a516-418f-9795-e6d3326899c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:08.207721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-4e5b2354-4f58-4b15-9a58-7b81c7c5b8dc None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:08.209358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd368b11-a516-418f-9795-e6d3326899c6 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:08.210272 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4e5b2354-4f58-4b15-9a58-7b81c7c5b8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:08.211737 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 18/35] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:08.212773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd368b11-a516-418f-9795-e6d3326899c6 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:08.238219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:08.312920 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:08.332355 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 18/36] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:08.341004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078261-aa10-4585-9e08-4eed8631fc8e None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:08.341344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078261-aa10-4585-9e08-4eed8631fc8e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:08.341636 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078261-aa10-4585-9e08-4eed8631fc8e None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:08.343292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 19/37] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:08.344186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078261-aa10-4585-9e08-4eed8631fc8e None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:08.352394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd368b11-a516-418f-9795-e6d3326899c6 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:08.404416 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd52b99-05cf-4707-9591-d704a105a15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:08.405885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52b99-05cf-4707-9591-d704a105a15e None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:08.406478 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52b99-05cf-4707-9591-d704a105a15e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:08.406977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd52b99-05cf-4707-9591-d704a105a15e None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:08.408812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd52b99-05cf-4707-9591-d704a105a15e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:08.411741 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd52b99-05cf-4707-9591-d704a105a15e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:08.520881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078261-aa10-4585-9e08-4eed8631fc8e None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:08.566153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a514ed-8ddf-4626-bce2-be385b7fbe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:08.566847 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a514ed-8ddf-4626-bce2-be385b7fbe3d None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:08.567173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a514ed-8ddf-4626-bce2-be385b7fbe3d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:08.567415 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a514ed-8ddf-4626-bce2-be385b7fbe3d None admin] PATH_INFO: `/v3/domains/default/users/48e73f0688f64fae87f2adc4e4e25455/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:08.569496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a514ed-8ddf-4626-bce2-be385b7fbe3d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=48e73f0688f64fae87f2adc4e4e25455, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:08.571184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a514ed-8ddf-4626-bce2-be385b7fbe3d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:08.587701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 20/38] 10.222.0.57 () {58 vars in 1361 bytes} [Tue Aug 2 08:09:08 2022] PUT /identity/v3/domains/default/users/48e73f0688f64fae87f2adc4e4e25455/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:09:08.589409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf4e26-9079-4f3b-81c1-c7a0638ec7e3 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:08.589904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf4e26-9079-4f3b-81c1-c7a0638ec7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:08.590418 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf4e26-9079-4f3b-81c1-c7a0638ec7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:08.602089 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:09:08 2022] POST /identity/v3/projects => generated 301 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:08.603283 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd52b99-05cf-4707-9591-d704a105a15e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:08.619256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-0bbf4e26-9079-4f3b-81c1-c7a0638ec7e3 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:08.622187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-0bbf4e26-9079-4f3b-81c1-c7a0638ec7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:08.715683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:08.761481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 21/40] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:08.786136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf4e26-9079-4f3b-81c1-c7a0638ec7e3 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:08.805261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:08.858470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd52b99-05cf-4707-9591-d704a105a15e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:08.907343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdac29a-2902-46b1-adc2-0fc198af1c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:08.907567 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdac29a-2902-46b1-adc2-0fc198af1c0a None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:08.907712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdac29a-2902-46b1-adc2-0fc198af1c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:08.907999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdac29a-2902-46b1-adc2-0fc198af1c0a None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:08.908752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdac29a-2902-46b1-adc2-0fc198af1c0a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:08.911977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdac29a-2902-46b1-adc2-0fc198af1c0a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:08.933377 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 2 08:09:08 2022] POST /identity/v3/roles => generated 225 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:08.940656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb516a-bfab-4444-818a-825b64e3dcff None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:08.940656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb516a-bfab-4444-818a-825b64e3dcff None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:08.940656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb516a-bfab-4444-818a-825b64e3dcff None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:08.940656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 21/42] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:08.941932 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf4e26-9079-4f3b-81c1-c7a0638ec7e3 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:08.943357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775106-fa00-4432-802f-995d99fbcc8b None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:08.943863 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775106-fa00-4432-802f-995d99fbcc8b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:08.944332 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775106-fa00-4432-802f-995d99fbcc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:08.965935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-08775106-fa00-4432-802f-995d99fbcc8b None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:08.967655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-08775106-fa00-4432-802f-995d99fbcc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:08.994714 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86f8be-03d6-4bab-a9a7-9dd5537f81d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:08.995570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86f8be-03d6-4bab-a9a7-9dd5537f81d6 None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:08.996386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86f8be-03d6-4bab-a9a7-9dd5537f81d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:08.996724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86f8be-03d6-4bab-a9a7-9dd5537f81d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:08.997746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86f8be-03d6-4bab-a9a7-9dd5537f81d6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:08.999839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86f8be-03d6-4bab-a9a7-9dd5537f81d6 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:09.026657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 22/43] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 2 08:09:08 2022] POST /identity/v3/roles => generated 223 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:09:09.064839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 22/44] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:09.089771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86f8be-03d6-4bab-a9a7-9dd5537f81d6 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:09.148761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:09.224221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86f8be-03d6-4bab-a9a7-9dd5537f81d6 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:09.262896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba977b-acdf-4a86-9579-2407de8f88cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:09.263560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba977b-acdf-4a86-9579-2407de8f88cd None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:09.263851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba977b-acdf-4a86-9579-2407de8f88cd None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:09.264135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba977b-acdf-4a86-9579-2407de8f88cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:09.265384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba977b-acdf-4a86-9579-2407de8f88cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:09.267468 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba977b-acdf-4a86-9579-2407de8f88cd None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:09.269252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 23/45] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:09.274781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08775106-fa00-4432-802f-995d99fbcc8b None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:09.344206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:09.395279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08775106-fa00-4432-802f-995d99fbcc8b None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:09.443289 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35388379-80fd-42c9-9623-1b4c93ab166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:09.443927 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388379-80fd-42c9-9623-1b4c93ab166a None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:09.444215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388379-80fd-42c9-9623-1b4c93ab166a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:09.444498 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35388379-80fd-42c9-9623-1b4c93ab166a None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:09.445206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35388379-80fd-42c9-9623-1b4c93ab166a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:09.446711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35388379-80fd-42c9-9623-1b4c93ab166a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:09.474527 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:09:09 2022] POST /identity/v3/projects => generated 312 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:10.780059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9aead-4621-4a9a-a81f-86922ef3d2cc None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:10.780582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9aead-4621-4a9a-a81f-86922ef3d2cc None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:10.780773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9aead-4621-4a9a-a81f-86922ef3d2cc None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:10.782149 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 24/47] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:10.787540 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8deace-a1da-4180-83d2-a5d59c4c5f07 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:10.788001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8deace-a1da-4180-83d2-a5d59c4c5f07 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:10.788125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8deace-a1da-4180-83d2-a5d59c4c5f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:10.808381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6a8deace-a1da-4180-83d2-a5d59c4c5f07 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:10.809608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6a8deace-a1da-4180-83d2-a5d59c4c5f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:10.886771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 24/48] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:10.911236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9aead-4621-4a9a-a81f-86922ef3d2cc None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:11.024050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9aead-4621-4a9a-a81f-86922ef3d2cc None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:11.035494 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:11.061893 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4548dcd-5327-4b3f-97be-b7ff3112f137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:11.062574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4548dcd-5327-4b3f-97be-b7ff3112f137 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:11.062880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4548dcd-5327-4b3f-97be-b7ff3112f137 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:11.063150 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4548dcd-5327-4b3f-97be-b7ff3112f137 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:11.075277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4548dcd-5327-4b3f-97be-b7ff3112f137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-d4548dcd-5327-4b3f-97be-b7ff3112f137 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:11.080365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:11.081194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:11.082058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 25/49] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:09:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:11.087977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8deace-a1da-4180-83d2-a5d59c4c5f07 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:11.133829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:11.200524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8deace-a1da-4180-83d2-a5d59c4c5f07 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:11.237434 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c08f5-3791-40e2-967c-00f834bbf397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:11.238185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c08f5-3791-40e2-967c-00f834bbf397 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:11.238474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c08f5-3791-40e2-967c-00f834bbf397 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:11.238765 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c08f5-3791-40e2-967c-00f834bbf397 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:11.239478 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c08f5-3791-40e2-967c-00f834bbf397 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:11.239789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c08f5-3791-40e2-967c-00f834bbf397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:11.241156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c08f5-3791-40e2-967c-00f834bbf397 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:11.251754 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 25/50] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:11.257128 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4548dcd-5327-4b3f-97be-b7ff3112f137 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:11.372812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4548dcd-5327-4b3f-97be-b7ff3112f137 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:11.416780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f68b7-588a-42d9-8c3f-afd8fe84ffc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:11.417832 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f68b7-588a-42d9-8c3f-afd8fe84ffc3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:11.418221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f68b7-588a-42d9-8c3f-afd8fe84ffc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:11.418558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f68b7-588a-42d9-8c3f-afd8fe84ffc3 None admin] PATH_INFO: `/v3/users/48e73f0688f64fae87f2adc4e4e25455` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:11.420023 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f68b7-588a-42d9-8c3f-afd8fe84ffc3 None admin] RBAC: Authorizing `identity:get_user(user_id=48e73f0688f64fae87f2adc4e4e25455)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:11.421635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f68b7-588a-42d9-8c3f-afd8fe84ffc3 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:11.424134 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 26/51] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:11 2022] GET /identity/v3/users/48e73f0688f64fae87f2adc4e4e25455 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:11.430688 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c08f5-3791-40e2-967c-00f834bbf397 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:11.533997 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cf4c1-603d-4b1d-8310-abeb27c993ee None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:11.534309 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cf4c1-603d-4b1d-8310-abeb27c993ee None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:11.534596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cf4c1-603d-4b1d-8310-abeb27c993ee None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:11.535982 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 27/52] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:09:11.542567 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d792-519c-424c-b2ad-61f72fbda5b6 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:11.542864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d792-519c-424c-b2ad-61f72fbda5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:11.543148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5d792-519c-424c-b2ad-61f72fbda5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:11.546224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c08f5-3791-40e2-967c-00f834bbf397 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:11.550136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:11.563140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-7af5d792-519c-424c-b2ad-61f72fbda5b6 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:11.564333 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7af5d792-519c-424c-b2ad-61f72fbda5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:11.585727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7217a73-ed0a-474f-bf22-2e7738847ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:11.586504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7217a73-ed0a-474f-bf22-2e7738847ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:11.586786 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7217a73-ed0a-474f-bf22-2e7738847ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:11.587062 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7217a73-ed0a-474f-bf22-2e7738847ba7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:11.588225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7217a73-ed0a-474f-bf22-2e7738847ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:11.589672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7217a73-ed0a-474f-bf22-2e7738847ba7 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:11.591465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:11.597437 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7217a73-ed0a-474f-bf22-2e7738847ba7 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:11.598844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:11.640818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 28/54] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:11.664278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5d792-519c-424c-b2ad-61f72fbda5b6 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:11.703625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7217a73-ed0a-474f-bf22-2e7738847ba7 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:11.738993 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20081edb-3486-4eab-bfc5-5ca95b769c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:11.739621 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20081edb-3486-4eab-bfc5-5ca95b769c81 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:11.739902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20081edb-3486-4eab-bfc5-5ca95b769c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:11.740181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20081edb-3486-4eab-bfc5-5ca95b769c81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:11.741008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20081edb-3486-4eab-bfc5-5ca95b769c81 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.domain.id=default, user.id=48e73f0688f64fae87f2adc4e4e25455) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:11.741316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20081edb-3486-4eab-bfc5-5ca95b769c81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:11.742787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20081edb-3486-4eab-bfc5-5ca95b769c81 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:11.752239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1322 bytes} [Tue Aug 2 08:09:11 2022] GET /identity/v3/role_assignments?user.id=48e73f0688f64fae87f2adc4e4e25455&scope.domain.id=default&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:11.777238 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5d792-519c-424c-b2ad-61f72fbda5b6 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:11.817220 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34892677-47af-4281-839a-a7d48dae45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:11.817913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34892677-47af-4281-839a-a7d48dae45f2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:11.818192 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34892677-47af-4281-839a-a7d48dae45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:11.818471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34892677-47af-4281-839a-a7d48dae45f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:11.819821 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34892677-47af-4281-839a-a7d48dae45f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:11.821569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34892677-47af-4281-839a-a7d48dae45f2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:11.823463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 29/56] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:11.829813 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20081edb-3486-4eab-bfc5-5ca95b769c81 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:11.872770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:11.945950 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20081edb-3486-4eab-bfc5-5ca95b769c81 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:11.986418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38af383-0895-4458-a274-bed190a43cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:11.987052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38af383-0895-4458-a274-bed190a43cfe None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:11.987340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38af383-0895-4458-a274-bed190a43cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:11.987628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38af383-0895-4458-a274-bed190a43cfe None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:11.988331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38af383-0895-4458-a274-bed190a43cfe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:11.989778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38af383-0895-4458-a274-bed190a43cfe None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:12.025326 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 28/57] 10.222.0.57 () {60 vars in 1140 bytes} [Tue Aug 2 08:09:11 2022] POST /identity/v3/projects => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:14.047491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a533322-a1b9-404b-8426-08cf54fb245f None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:14.048583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a533322-a1b9-404b-8426-08cf54fb245f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:14.048583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a533322-a1b9-404b-8426-08cf54fb245f None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:14.049921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 30/58] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:14.055061 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0fe38-8062-4c8e-8314-3afe999b12c2 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:14.055624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0fe38-8062-4c8e-8314-3afe999b12c2 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:14.055930 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0fe38-8062-4c8e-8314-3afe999b12c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:14.075401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-d9b0fe38-8062-4c8e-8314-3afe999b12c2 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:14.076604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d9b0fe38-8062-4c8e-8314-3afe999b12c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:14.143977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 29/59] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:14.167948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a533322-a1b9-404b-8426-08cf54fb245f None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:14.204596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:14.269096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a533322-a1b9-404b-8426-08cf54fb245f None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:14.304730 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df97a9c-2932-4041-8986-ba02ce7f69d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:14.305413 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df97a9c-2932-4041-8986-ba02ce7f69d7 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:14.305725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df97a9c-2932-4041-8986-ba02ce7f69d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:14.306042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df97a9c-2932-4041-8986-ba02ce7f69d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:14.307284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df97a9c-2932-4041-8986-ba02ce7f69d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:14.308825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df97a9c-2932-4041-8986-ba02ce7f69d7 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:14.310578 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 31/60] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:14.316897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0fe38-8062-4c8e-8314-3afe999b12c2 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:14.336893 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:14.420005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0fe38-8062-4c8e-8314-3afe999b12c2 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:14.454434 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32af725-0ab3-4da0-91f3-37f157517111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:14.455065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32af725-0ab3-4da0-91f3-37f157517111 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:14.455350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32af725-0ab3-4da0-91f3-37f157517111 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:14.455630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32af725-0ab3-4da0-91f3-37f157517111 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:14.456321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32af725-0ab3-4da0-91f3-37f157517111 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:14.457775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32af725-0ab3-4da0-91f3-37f157517111 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:14.484263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 30/61] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:09:14 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:17.540820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134e772-20fc-4fb6-8775-77f8aa5e933d None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:17.541583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134e772-20fc-4fb6-8775-77f8aa5e933d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:17.541688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134e772-20fc-4fb6-8775-77f8aa5e933d None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:17.543029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 32/62] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:17.549127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2467ede-4b8c-4739-84ac-5eb157257241 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:17.549972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2467ede-4b8c-4739-84ac-5eb157257241 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:17.550479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2467ede-4b8c-4739-84ac-5eb157257241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:17.579146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-d2467ede-4b8c-4739-84ac-5eb157257241 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:17.580412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d2467ede-4b8c-4739-84ac-5eb157257241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:17.669002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 31/63] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:17.702382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134e772-20fc-4fb6-8775-77f8aa5e933d None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:17.853151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134e772-20fc-4fb6-8775-77f8aa5e933d None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:17.858999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:17.923703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc86ca-a5b9-4176-b5a5-4ed93573aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:17.924318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc86ca-a5b9-4176-b5a5-4ed93573aad3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:17.924610 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc86ca-a5b9-4176-b5a5-4ed93573aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:17.924881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc86ca-a5b9-4176-b5a5-4ed93573aad3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:17.940417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc86ca-a5b9-4176-b5a5-4ed93573aad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-82fc86ca-a5b9-4176-b5a5-4ed93573aad3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:17.945416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:17.946480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:17.947265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:17.952080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 33/64] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:17.953427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2467ede-4b8c-4739-84ac-5eb157257241 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:17.958351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:18.009144 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241902-e447-41e9-b25e-bbbcb1c765b1 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.010053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241902-e447-41e9-b25e-bbbcb1c765b1 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.010910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59241902-e447-41e9-b25e-bbbcb1c765b1 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.012566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 34/65] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:18.018549 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c8a5-2c81-4b14-84fe-17fa2c6fa559 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.019019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c8a5-2c81-4b14-84fe-17fa2c6fa559 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.019438 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c8a5-2c81-4b14-84fe-17fa2c6fa559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.057722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-5265c8a5-2c81-4b14-84fe-17fa2c6fa559 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:18.060052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5265c8a5-2c81-4b14-84fe-17fa2c6fa559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:18.126923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2467ede-4b8c-4739-84ac-5eb157257241 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:18.163372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424b7f-7d2b-4eca-9b9e-5d50d3f7b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:18.164431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424b7f-7d2b-4eca-9b9e-5d50d3f7b5ed None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.164856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424b7f-7d2b-4eca-9b9e-5d50d3f7b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.165269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424b7f-7d2b-4eca-9b9e-5d50d3f7b5ed None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.166173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b424b7f-7d2b-4eca-9b9e-5d50d3f7b5ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:18.166866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b424b7f-7d2b-4eca-9b9e-5d50d3f7b5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:18.167967 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 35/66] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:18.168703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b424b7f-7d2b-4eca-9b9e-5d50d3f7b5ed None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:18.169237 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa481-076a-499e-b38f-b14714efe961 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.169532 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa481-076a-499e-b38f-b14714efe961 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.169824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa481-076a-499e-b38f-b14714efe961 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.180469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 36/67] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:18.185349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20e624-dd6d-409a-a3a3-907860be1b7a None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.185783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20e624-dd6d-409a-a3a3-907860be1b7a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.186233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20e624-dd6d-409a-a3a3-907860be1b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.193321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 32/68] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:18.196302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424b7f-7d2b-4eca-9b9e-5d50d3f7b5ed None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:18.211419 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-eb20e624-dd6d-409a-a3a3-907860be1b7a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:18.212998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-eb20e624-dd6d-409a-a3a3-907860be1b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:18.286739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:18.292950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 37/69] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:18.294811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20e624-dd6d-409a-a3a3-907860be1b7a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:18.323802 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:18.347703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424b7f-7d2b-4eca-9b9e-5d50d3f7b5ed None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:18.384575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017d3d-5dec-4bbb-ab61-cb5ff8dcf408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:18.385639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017d3d-5dec-4bbb-ab61-cb5ff8dcf408 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.386181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017d3d-5dec-4bbb-ab61-cb5ff8dcf408 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.386619 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017d3d-5dec-4bbb-ab61-cb5ff8dcf408 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.399055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76017d3d-5dec-4bbb-ab61-cb5ff8dcf408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-76017d3d-5dec-4bbb-ab61-cb5ff8dcf408 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:18.404800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:18.405647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:18.406435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:18.409212 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 33/70] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:09:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:18.410242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017d3d-5dec-4bbb-ab61-cb5ff8dcf408 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:18.427213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20e624-dd6d-409a-a3a3-907860be1b7a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:18.467940 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1b879-cd4f-461c-bc64-a5501337b399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:18.468593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1b879-cd4f-461c-bc64-a5501337b399 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.468875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1b879-cd4f-461c-bc64-a5501337b399 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.469152 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1b879-cd4f-461c-bc64-a5501337b399 None admin] PATH_INFO: `/v3/users/5b24fddf649e4ed58d13e5de21990398` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.484148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1b879-cd4f-461c-bc64-a5501337b399 None admin] RBAC: Authorizing `identity:get_user(user_id=5b24fddf649e4ed58d13e5de21990398)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:18.486198 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1b879-cd4f-461c-bc64-a5501337b399 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:18.488062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 38/71] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:18 2022] GET /identity/v3/users/5b24fddf649e4ed58d13e5de21990398 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:18.488670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1b879-cd4f-461c-bc64-a5501337b399 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:18.528060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017d3d-5dec-4bbb-ab61-cb5ff8dcf408 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:18.554851 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:18.565149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d366e-d9c5-4bbf-be95-de607df105cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:18.565804 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d366e-d9c5-4bbf-be95-de607df105cd None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.566124 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d366e-d9c5-4bbf-be95-de607df105cd None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.566417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d366e-d9c5-4bbf-be95-de607df105cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.573226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:18.577452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d366e-d9c5-4bbf-be95-de607df105cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-ff4d366e-d9c5-4bbf-be95-de607df105cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:18.582372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:18.583306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:18.584072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 34/72] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:09:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:18.584710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff872b93-abc0-48d3-9512-352a22ec95ea None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.585028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff872b93-abc0-48d3-9512-352a22ec95ea None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.585232 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff872b93-abc0-48d3-9512-352a22ec95ea None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.586653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 35/73] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:18.587513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff872b93-abc0-48d3-9512-352a22ec95ea None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:18.597810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1b879-cd4f-461c-bc64-a5501337b399 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:18.632389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ea9dd-9336-426d-92d5-3f76fb344822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:18.633019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea9dd-9336-426d-92d5-3f76fb344822 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.633305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea9dd-9336-426d-92d5-3f76fb344822 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.633585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ea9dd-9336-426d-92d5-3f76fb344822 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.634343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ea9dd-9336-426d-92d5-3f76fb344822 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:18.634649 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ea9dd-9336-426d-92d5-3f76fb344822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:18.636020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ea9dd-9336-426d-92d5-3f76fb344822 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:18.643999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 39/74] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:09:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:18.645511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e076fd0-08e2-4398-abaf-12d91fbbb2d0 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.645800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e076fd0-08e2-4398-abaf-12d91fbbb2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.646102 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e076fd0-08e2-4398-abaf-12d91fbbb2d0 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.647317 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 40/75] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:18.648008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e076fd0-08e2-4398-abaf-12d91fbbb2d0 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:18.700906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff872b93-abc0-48d3-9512-352a22ec95ea None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:18.734542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ee3b9-314d-4d67-aa96-df1b9af9aa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:18.735081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ee3b9-314d-4d67-aa96-df1b9af9aa48 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.735851 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ee3b9-314d-4d67-aa96-df1b9af9aa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.736127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ee3b9-314d-4d67-aa96-df1b9af9aa48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.761605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e076fd0-08e2-4398-abaf-12d91fbbb2d0 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:18.792008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:18.796199 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58989f9-4156-41dc-a599-cd1ae7a01bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:18.796835 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58989f9-4156-41dc-a599-cd1ae7a01bbb None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.797123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58989f9-4156-41dc-a599-cd1ae7a01bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.797405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58989f9-4156-41dc-a599-cd1ae7a01bbb None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.798654 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58989f9-4156-41dc-a599-cd1ae7a01bbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:18.798965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58989f9-4156-41dc-a599-cd1ae7a01bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:18.800351 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58989f9-4156-41dc-a599-cd1ae7a01bbb None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:18.805832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ee3b9-314d-4d67-aa96-df1b9af9aa48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:18.807327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ee3b9-314d-4d67-aa96-df1b9af9aa48 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:18.808995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 41/76] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:18.810195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c2b3-2cdc-483d-ade9-83c1ee7d59e0 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.810490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c2b3-2cdc-483d-ade9-83c1ee7d59e0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.810772 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86c2b3-2cdc-483d-ade9-83c1ee7d59e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.823512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:18.829776 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-dc86c2b3-2cdc-483d-ade9-83c1ee7d59e0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:18.831025 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-dc86c2b3-2cdc-483d-ade9-83c1ee7d59e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:18.898787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 42/77] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:18.899747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86c2b3-2cdc-483d-ade9-83c1ee7d59e0 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:18.929809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 36/78] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:18.930975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff9d9-8e47-4ceb-acbf-166f62397994 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:18.931434 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff9d9-8e47-4ceb-acbf-166f62397994 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:18.931873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff9d9-8e47-4ceb-acbf-166f62397994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:18.950359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-0d9ff9d9-8e47-4ceb-acbf-166f62397994 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:18.951582 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0d9ff9d9-8e47-4ceb-acbf-166f62397994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:19.002637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86c2b3-2cdc-483d-ade9-83c1ee7d59e0 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:19.020028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 37/79] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:19.020885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ff9d9-8e47-4ceb-acbf-166f62397994 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:19.043597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:19.054547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b234d9-0cd7-45e9-ab6c-abf7f9db7a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:19.055206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b234d9-0cd7-45e9-ab6c-abf7f9db7a99 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:19.055490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b234d9-0cd7-45e9-ab6c-abf7f9db7a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:19.055771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b234d9-0cd7-45e9-ab6c-abf7f9db7a99 None admin] PATH_INFO: `/v3/users/5b24fddf649e4ed58d13e5de21990398` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:19.056972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b234d9-0cd7-45e9-ab6c-abf7f9db7a99 None admin] RBAC: Authorizing `identity:get_user(user_id=5b24fddf649e4ed58d13e5de21990398)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:19.058485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b234d9-0cd7-45e9-ab6c-abf7f9db7a99 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:19.063646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 43/80] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:18 2022] GET /identity/v3/users/5b24fddf649e4ed58d13e5de21990398 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:19.063646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b234d9-0cd7-45e9-ab6c-abf7f9db7a99 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:19.065463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:19.130774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ff9d9-8e47-4ceb-acbf-166f62397994 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:19.164500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1137d-db1d-4aec-b11f-eac1c77b10a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:19.165144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1137d-db1d-4aec-b11f-eac1c77b10a0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:19.165424 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1137d-db1d-4aec-b11f-eac1c77b10a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:19.165512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b234d9-0cd7-45e9-ab6c-abf7f9db7a99 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:19.165697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1137d-db1d-4aec-b11f-eac1c77b10a0 None admin] PATH_INFO: `/v3/users/48e73f0688f64fae87f2adc4e4e25455` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:19.167390 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1137d-db1d-4aec-b11f-eac1c77b10a0 None admin] RBAC: Authorizing `identity:get_user(user_id=48e73f0688f64fae87f2adc4e4e25455)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:19.169207 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1137d-db1d-4aec-b11f-eac1c77b10a0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:19.170939 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 38/81] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:19 2022] GET /identity/v3/users/48e73f0688f64fae87f2adc4e4e25455 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:19.171705 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1137d-db1d-4aec-b11f-eac1c77b10a0 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:19.202433 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862be93-5132-4177-a088-e71959f1f744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:19.203081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862be93-5132-4177-a088-e71959f1f744 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:19.203363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862be93-5132-4177-a088-e71959f1f744 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:19.203672 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862be93-5132-4177-a088-e71959f1f744 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:19.214442 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862be93-5132-4177-a088-e71959f1f744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-2862be93-5132-4177-a088-e71959f1f744 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:19.219411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:19.220349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:19.221118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 44/82] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:19.221756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862be93-5132-4177-a088-e71959f1f744 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:19.262258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:19.279211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1137d-db1d-4aec-b11f-eac1c77b10a0 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:19.284031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:19.314544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a54bc-f18b-48bd-ab3b-19d3ada07b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:19.316241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a54bc-f18b-48bd-ab3b-19d3ada07b2d None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:19.316532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a54bc-f18b-48bd-ab3b-19d3ada07b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:19.316810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a54bc-f18b-48bd-ab3b-19d3ada07b2d None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:19.317980 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a54bc-f18b-48bd-ab3b-19d3ada07b2d None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:19.319455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a54bc-f18b-48bd-ab3b-19d3ada07b2d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:19.321295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 39/83] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:19 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:19.321879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a54bc-f18b-48bd-ab3b-19d3ada07b2d None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:19.328792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862be93-5132-4177-a088-e71959f1f744 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:19.363295 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916aabf-b532-42d7-b6de-6f8616614c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:19.363959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916aabf-b532-42d7-b6de-6f8616614c68 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:19.364251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916aabf-b532-42d7-b6de-6f8616614c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:19.364534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916aabf-b532-42d7-b6de-6f8616614c68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:19.365693 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916aabf-b532-42d7-b6de-6f8616614c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:19.367254 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916aabf-b532-42d7-b6de-6f8616614c68 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:19.368932 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 45/84] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:19.369701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916aabf-b532-42d7-b6de-6f8616614c68 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:19.428453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a54bc-f18b-48bd-ab3b-19d3ada07b2d None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:19.463320 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e149b15-c0b2-4652-855e-cd82eb5039f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:19.463950 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e149b15-c0b2-4652-855e-cd82eb5039f9 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:19.464234 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e149b15-c0b2-4652-855e-cd82eb5039f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:19.464515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e149b15-c0b2-4652-855e-cd82eb5039f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:19.479238 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916aabf-b532-42d7-b6de-6f8616614c68 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:19.487009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:19.508703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:19.514757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69996805-11de-4e14-9ee3-4b3d9f617ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:19.515569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69996805-11de-4e14-9ee3-4b3d9f617ade None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:19.515848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69996805-11de-4e14-9ee3-4b3d9f617ade None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:19.516124 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69996805-11de-4e14-9ee3-4b3d9f617ade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:19.534714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e149b15-c0b2-4652-855e-cd82eb5039f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:19.536168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e149b15-c0b2-4652-855e-cd82eb5039f9 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:19.598895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69996805-11de-4e14-9ee3-4b3d9f617ade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:19.601165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69996805-11de-4e14-9ee3-4b3d9f617ade None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:19.640329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 40/85] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:19.641933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e149b15-c0b2-4652-855e-cd82eb5039f9 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:19.693263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:19.708779 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 46/86] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:19.709630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69996805-11de-4e14-9ee3-4b3d9f617ade None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:19.740748 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:19.746493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e149b15-c0b2-4652-855e-cd82eb5039f9 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:19.780445 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbd07f-52c1-4b31-a4d8-e75514473e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:19.780990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbd07f-52c1-4b31-a4d8-e75514473e0a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:19.781273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbd07f-52c1-4b31-a4d8-e75514473e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:19.781556 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbd07f-52c1-4b31-a4d8-e75514473e0a None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:19.782833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbd07f-52c1-4b31-a4d8-e75514473e0a None admin] RBAC: Adding query filter params (name=member) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:19.783145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbd07f-52c1-4b31-a4d8-e75514473e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:19.784517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbd07f-52c1-4b31-a4d8-e75514473e0a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:19.793478 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 41/87] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:19.794309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbd07f-52c1-4b31-a4d8-e75514473e0a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:19.812146 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69996805-11de-4e14-9ee3-4b3d9f617ade None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:19.847006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816da2-704d-4c0d-a3f7-563c09d2cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:19.847626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816da2-704d-4c0d-a3f7-563c09d2cb4d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:19.847915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816da2-704d-4c0d-a3f7-563c09d2cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:19.848197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816da2-704d-4c0d-a3f7-563c09d2cb4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:19.848995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6816da2-704d-4c0d-a3f7-563c09d2cb4d None admin] RBAC: Adding query filter params (role.id=a4aae8b3b8b4486389006b0d25566eb6, scope.project.id=85dec1bdd87547f7b0d6bdc818811672, user.id=5b24fddf649e4ed58d13e5de21990398) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:19.849312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6816da2-704d-4c0d-a3f7-563c09d2cb4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:19.850804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6816da2-704d-4c0d-a3f7-563c09d2cb4d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:19.856547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 47/88] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:19 2022] GET /identity/v3/role_assignments?user.id=5b24fddf649e4ed58d13e5de21990398&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:19.861354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816da2-704d-4c0d-a3f7-563c09d2cb4d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:19.923358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbd07f-52c1-4b31-a4d8-e75514473e0a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:19.939745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:19.962412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c92c4-d237-4884-8719-e90fd3432371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:19.963463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c92c4-d237-4884-8719-e90fd3432371 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:19.963463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c92c4-d237-4884-8719-e90fd3432371 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:19.963607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c92c4-d237-4884-8719-e90fd3432371 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:19.964259 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c92c4-d237-4884-8719-e90fd3432371 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:19.965737 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c92c4-d237-4884-8719-e90fd3432371 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:19.983286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:20.002050 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 42/89] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:09:19 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:20.002050 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c92c4-d237-4884-8719-e90fd3432371 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:20.002345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816da2-704d-4c0d-a3f7-563c09d2cb4d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:20.053207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e077b2-6629-4c3f-9a3d-186d1373d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:20.053953 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e077b2-6629-4c3f-9a3d-186d1373d49e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:20.054303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e077b2-6629-4c3f-9a3d-186d1373d49e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:20.054702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e077b2-6629-4c3f-9a3d-186d1373d49e None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:20.056251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e077b2-6629-4c3f-9a3d-186d1373d49e None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:20.058146 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e077b2-6629-4c3f-9a3d-186d1373d49e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:20.060283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 48/90] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:19 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:20.066409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e077b2-6629-4c3f-9a3d-186d1373d49e None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:20.147343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c92c4-d237-4884-8719-e90fd3432371 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:20.199464 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e077b2-6629-4c3f-9a3d-186d1373d49e None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:20.200100 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da38f2-1c31-4f97-b4e3-3faa3b582da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:20.200831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da38f2-1c31-4f97-b4e3-3faa3b582da3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:20.201260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da38f2-1c31-4f97-b4e3-3faa3b582da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:20.201525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da38f2-1c31-4f97-b4e3-3faa3b582da3 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:20.203578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da38f2-1c31-4f97-b4e3-3faa3b582da3 None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:20.206462 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da38f2-1c31-4f97-b4e3-3faa3b582da3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:20.208304 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 43/91] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:19 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:20.209154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da38f2-1c31-4f97-b4e3-3faa3b582da3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:20.242580 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5814a8f-2b5d-452b-8d02-a8df14993d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:20.243367 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5814a8f-2b5d-452b-8d02-a8df14993d93 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:20.243764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5814a8f-2b5d-452b-8d02-a8df14993d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:20.244178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5814a8f-2b5d-452b-8d02-a8df14993d93 None admin] PATH_INFO: `/v3/users/5b24fddf649e4ed58d13e5de21990398` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:20.245829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5814a8f-2b5d-452b-8d02-a8df14993d93 None admin] RBAC: Authorizing `identity:get_user(user_id=5b24fddf649e4ed58d13e5de21990398)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:20.247350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5814a8f-2b5d-452b-8d02-a8df14993d93 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:20.249132 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 49/92] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:20 2022] GET /identity/v3/users/5b24fddf649e4ed58d13e5de21990398 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:20.249714 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5814a8f-2b5d-452b-8d02-a8df14993d93 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:20.261593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:20.296265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:20.366521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da38f2-1c31-4f97-b4e3-3faa3b582da3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:20.406102 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5814a8f-2b5d-452b-8d02-a8df14993d93 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:20.415907 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8617d-f047-4471-ac88-d3a4bed2fceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:20.417070 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8617d-f047-4471-ac88-d3a4bed2fceb None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:20.417503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8617d-f047-4471-ac88-d3a4bed2fceb None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:20.418050 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8617d-f047-4471-ac88-d3a4bed2fceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:20.419079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8617d-f047-4471-ac88-d3a4bed2fceb None admin] RBAC: Adding query filter params (role.id=e1f4e92f38534e1d80123b0beaa2be47, scope.project.id=85dec1bdd87547f7b0d6bdc818811672, user.id=5b24fddf649e4ed58d13e5de21990398) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:20.419595 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8617d-f047-4471-ac88-d3a4bed2fceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:20.422073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8617d-f047-4471-ac88-d3a4bed2fceb None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:20.429739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 44/93] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:20 2022] GET /identity/v3/role_assignments?user.id=5b24fddf649e4ed58d13e5de21990398&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=e1f4e92f38534e1d80123b0beaa2be47 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:20.431403 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8617d-f047-4471-ac88-d3a4bed2fceb None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:20.457189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5e15-f6b5-42ae-92fc-4634a644ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:20.457863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5e15-f6b5-42ae-92fc-4634a644ade2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:20.458201 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5e15-f6b5-42ae-92fc-4634a644ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:20.458600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5e15-f6b5-42ae-92fc-4634a644ade2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:20.459444 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e5e15-f6b5-42ae-92fc-4634a644ade2 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=85dec1bdd87547f7b0d6bdc818811672, user.id=48e73f0688f64fae87f2adc4e4e25455) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:20.459824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e5e15-f6b5-42ae-92fc-4634a644ade2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:20.461327 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e5e15-f6b5-42ae-92fc-4634a644ade2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:20.472244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 50/94] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:20 2022] GET /identity/v3/role_assignments?user.id=48e73f0688f64fae87f2adc4e4e25455&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:20.677458 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8617d-f047-4471-ac88-d3a4bed2fceb None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:20.680131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:20.731962 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3032007-fd99-4743-a5b0-de407a62d8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:20.732973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3032007-fd99-4743-a5b0-de407a62d8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:20.733455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3032007-fd99-4743-a5b0-de407a62d8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:20.733950 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3032007-fd99-4743-a5b0-de407a62d8b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:20.815249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3032007-fd99-4743-a5b0-de407a62d8b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:20.817117 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3032007-fd99-4743-a5b0-de407a62d8b5 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:20.962375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 45/95] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:20.968363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5e15-f6b5-42ae-92fc-4634a644ade2 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:21.084392 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:21.091484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5e15-f6b5-42ae-92fc-4634a644ade2 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:21.127713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3d2dd-83e6-41d8-91fe-d03256168e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:21.128374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d2dd-83e6-41d8-91fe-d03256168e02 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:21.128661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d2dd-83e6-41d8-91fe-d03256168e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:21.128943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d2dd-83e6-41d8-91fe-d03256168e02 None admin] PATH_INFO: `/v3/projects/27209056e4aa4fb49aa5c2a72a016bec` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:21.130200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3d2dd-83e6-41d8-91fe-d03256168e02 None admin] RBAC: Authorizing `identity:get_project(project_id=27209056e4aa4fb49aa5c2a72a016bec)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:21.131943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3d2dd-83e6-41d8-91fe-d03256168e02 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:21.133840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 51/96] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:20 2022] GET /identity/v3/projects/27209056e4aa4fb49aa5c2a72a016bec => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:21.140577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3032007-fd99-4743-a5b0-de407a62d8b5 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:21.144487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:21.369073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3032007-fd99-4743-a5b0-de407a62d8b5 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:21.426814 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dff7be-0ffb-4f7e-84f6-1d1802195e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:21.428282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dff7be-0ffb-4f7e-84f6-1d1802195e07 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:21.429104 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dff7be-0ffb-4f7e-84f6-1d1802195e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:21.429847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dff7be-0ffb-4f7e-84f6-1d1802195e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:21.431609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dff7be-0ffb-4f7e-84f6-1d1802195e07 None admin] RBAC: Adding query filter params (role.id=a4aae8b3b8b4486389006b0d25566eb6, scope.project.id=27209056e4aa4fb49aa5c2a72a016bec, user.id=5b24fddf649e4ed58d13e5de21990398) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:21.432395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dff7be-0ffb-4f7e-84f6-1d1802195e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:21.435396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dff7be-0ffb-4f7e-84f6-1d1802195e07 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:21.445985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 46/97] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:21 2022] GET /identity/v3/role_assignments?user.id=5b24fddf649e4ed58d13e5de21990398&scope.project.id=27209056e4aa4fb49aa5c2a72a016bec&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:22.968538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756920d-06da-4b9e-a861-e08a68396ab2 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:22.969045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756920d-06da-4b9e-a861-e08a68396ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:22.969118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756920d-06da-4b9e-a861-e08a68396ab2 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:22.971286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 52/98] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:22.976295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ecb7e-31a1-4640-8a39-a678c2f7f301 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:22.977140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ecb7e-31a1-4640-8a39-a678c2f7f301 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:22.977621 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ecb7e-31a1-4640-8a39-a678c2f7f301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:23.006131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-570ecb7e-31a1-4640-8a39-a678c2f7f301 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:23.007694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-570ecb7e-31a1-4640-8a39-a678c2f7f301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:23.092688 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:23.101297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 47/99] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:23.135533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756920d-06da-4b9e-a861-e08a68396ab2 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:23.240441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50b60c-1766-4618-9a02-2c22632e207b None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:23.241069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50b60c-1766-4618-9a02-2c22632e207b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:23.241557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50b60c-1766-4618-9a02-2c22632e207b None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:23.243325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 48/100] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:09:23.249679 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb93c-e348-4616-8d7e-a31ae1420073 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:23.250241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb93c-e348-4616-8d7e-a31ae1420073 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:23.250764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cb93c-e348-4616-8d7e-a31ae1420073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:23.295138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-839cb93c-e348-4616-8d7e-a31ae1420073 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:23.296461 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-839cb93c-e348-4616-8d7e-a31ae1420073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:23.299787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756920d-06da-4b9e-a861-e08a68396ab2 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:23.378729 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cd905-8aee-4a56-b80e-dec02f0342a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:23.379402 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cd905-8aee-4a56-b80e-dec02f0342a8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:23.379692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cd905-8aee-4a56-b80e-dec02f0342a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:23.379974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cd905-8aee-4a56-b80e-dec02f0342a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:23.401061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cd905-8aee-4a56-b80e-dec02f0342a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-ff1cd905-8aee-4a56-b80e-dec02f0342a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:23.406629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:23.408068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:23.409251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 53/101] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:23.415899 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cd905-8aee-4a56-b80e-dec02f0342a8 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:23.467047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:23.472709 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 49/102] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:23.491217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80c8a-bc9c-43ce-a24c-7a1d17e2e28f None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:23.491470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80c8a-bc9c-43ce-a24c-7a1d17e2e28f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:23.491691 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80c8a-bc9c-43ce-a24c-7a1d17e2e28f None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:23.493580 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 50/103] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:09:23.507310 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e713d-ed51-4796-9072-279e6db97a3f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:23.507597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e713d-ed51-4796-9072-279e6db97a3f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:23.507952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e713d-ed51-4796-9072-279e6db97a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:23.543125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-b82e713d-ed51-4796-9072-279e6db97a3f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:23.544336 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b82e713d-ed51-4796-9072-279e6db97a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:23.593124 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cd905-8aee-4a56-b80e-dec02f0342a8 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:23.636870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 51/104] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:23.638465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e713d-ed51-4796-9072-279e6db97a3f None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:23.639692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d26783-cda4-4d40-bfd9-7cf42de87133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:23.640323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d26783-cda4-4d40-bfd9-7cf42de87133 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:23.640608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d26783-cda4-4d40-bfd9-7cf42de87133 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:23.640885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d26783-cda4-4d40-bfd9-7cf42de87133 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:23.642194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d26783-cda4-4d40-bfd9-7cf42de87133 None admin] RBAC: Adding query filter params (name=member) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:23.642506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d26783-cda4-4d40-bfd9-7cf42de87133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:23.645146 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d26783-cda4-4d40-bfd9-7cf42de87133 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:23.656002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 54/105] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:23.659590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d0914-38c2-4f0f-8da9-ca71f396239a None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:23.659590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d0914-38c2-4f0f-8da9-ca71f396239a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:23.659590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d0914-38c2-4f0f-8da9-ca71f396239a None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:23.659590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 55/106] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:23.665312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d0914-38c2-4f0f-8da9-ca71f396239a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:23.719263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:23.772911 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:23.776453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e713d-ed51-4796-9072-279e6db97a3f None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:23.790650 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d0914-38c2-4f0f-8da9-ca71f396239a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:23.815677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310f869-d0d2-4f53-99a9-2a3ebe5148ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:23.816331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310f869-d0d2-4f53-99a9-2a3ebe5148ea None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:23.816710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310f869-d0d2-4f53-99a9-2a3ebe5148ea None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:23.816990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310f869-d0d2-4f53-99a9-2a3ebe5148ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:23.828473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310f869-d0d2-4f53-99a9-2a3ebe5148ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:23.829529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dda617-2293-43ed-bc09-32bee0f68eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:23.830223 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dda617-2293-43ed-bc09-32bee0f68eaa None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:23.830510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dda617-2293-43ed-bc09-32bee0f68eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:23.830840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dda617-2293-43ed-bc09-32bee0f68eaa None admin] PATH_INFO: `/v3/users/5b24fddf649e4ed58d13e5de21990398` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:23.832139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dda617-2293-43ed-bc09-32bee0f68eaa None admin] RBAC: Authorizing `identity:get_user(user_id=5b24fddf649e4ed58d13e5de21990398)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-e310f869-d0d2-4f53-99a9-2a3ebe5148ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:23.833644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:23.834509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:23.835967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:23.836577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dda617-2293-43ed-bc09-32bee0f68eaa None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:23.836645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 52/107] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:09:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:23.836708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 56/108] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:23 2022] GET /identity/v3/users/5b24fddf649e4ed58d13e5de21990398 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:23.836708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dda617-2293-43ed-bc09-32bee0f68eaa None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:23.836835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b5b48-1a07-4779-b8c8-effe08b7ff57 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:23.841602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b5b48-1a07-4779-b8c8-effe08b7ff57 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:23.841999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b5b48-1a07-4779-b8c8-effe08b7ff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:23.861341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-554b5b48-1a07-4779-b8c8-effe08b7ff57 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:23.862559 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-554b5b48-1a07-4779-b8c8-effe08b7ff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:23.935539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 53/109] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:23.936173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b5b48-1a07-4779-b8c8-effe08b7ff57 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:23.969268 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dda617-2293-43ed-bc09-32bee0f68eaa None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:24.000455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:24.005213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f1a89-be16-45f9-9412-d94478442acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:24.005981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f1a89-be16-45f9-9412-d94478442acd None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.006295 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f1a89-be16-45f9-9412-d94478442acd None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.006585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f1a89-be16-45f9-9412-d94478442acd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.017011 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f1a89-be16-45f9-9412-d94478442acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-0f1f1a89-be16-45f9-9412-d94478442acd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:24.022606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:24.023687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:24.024623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:24.027009 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 57/110] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:24.027976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f1a89-be16-45f9-9412-d94478442acd None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:24.045435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:24.065561 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b5b48-1a07-4779-b8c8-effe08b7ff57 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:24.102979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f12bc-ca90-4d26-bca3-bd10c92847c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:24.103617 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f12bc-ca90-4d26-bca3-bd10c92847c9 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.103930 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f12bc-ca90-4d26-bca3-bd10c92847c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.104227 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f12bc-ca90-4d26-bca3-bd10c92847c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.104923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f12bc-ca90-4d26-bca3-bd10c92847c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:24.105238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f12bc-ca90-4d26-bca3-bd10c92847c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:24.106658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f12bc-ca90-4d26-bca3-bd10c92847c9 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:24.116480 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 54/111] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:09:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:24.122239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e00a6-4458-49c5-a1f9-b9b388971387 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.122542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e00a6-4458-49c5-a1f9-b9b388971387 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.123081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e00a6-4458-49c5-a1f9-b9b388971387 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.124188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 55/112] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:24.124846 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e00a6-4458-49c5-a1f9-b9b388971387 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:24.148604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f1a89-be16-45f9-9412-d94478442acd None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:24.187922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203dc31-b501-4bca-b136-c9bc8c70b899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:24.188582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203dc31-b501-4bca-b136-c9bc8c70b899 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.188872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203dc31-b501-4bca-b136-c9bc8c70b899 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.189212 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203dc31-b501-4bca-b136-c9bc8c70b899 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.190585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203dc31-b501-4bca-b136-c9bc8c70b899 None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:24.192086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203dc31-b501-4bca-b136-c9bc8c70b899 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:24.194135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 58/113] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:24 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:24.194820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203dc31-b501-4bca-b136-c9bc8c70b899 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:24.243696 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e00a6-4458-49c5-a1f9-b9b388971387 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:24.254752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:24.283475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf01161-c307-4a53-af3b-b6f314b5042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:24.284039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf01161-c307-4a53-af3b-b6f314b5042f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.284321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf01161-c307-4a53-af3b-b6f314b5042f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.284594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf01161-c307-4a53-af3b-b6f314b5042f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.288974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:24.298189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf01161-c307-4a53-af3b-b6f314b5042f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-4bf01161-c307-4a53-af3b-b6f314b5042f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:24.303279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:24.304165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 56/114] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:09:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:24.310645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf01161-c307-4a53-af3b-b6f314b5042f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:24.316262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203dc31-b501-4bca-b136-c9bc8c70b899 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:24.362836 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0dc02-e295-41da-844a-e5e673878c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:24.363475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0dc02-e295-41da-844a-e5e673878c99 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.363763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0dc02-e295-41da-844a-e5e673878c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.364045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0dc02-e295-41da-844a-e5e673878c99 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.364937 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0dc02-e295-41da-844a-e5e673878c99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:24.365207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0dc02-e295-41da-844a-e5e673878c99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:24.366742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0dc02-e295-41da-844a-e5e673878c99 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:24.376902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 59/115] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:24.378289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52e57-bedf-46c3-a834-bd58de625b5e None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.378583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52e57-bedf-46c3-a834-bd58de625b5e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.378866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e52e57-bedf-46c3-a834-bd58de625b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.397387 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-91e52e57-bedf-46c3-a834-bd58de625b5e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:24.398819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-91e52e57-bedf-46c3-a834-bd58de625b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:24.426320 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf01161-c307-4a53-af3b-b6f314b5042f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:24.459829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672e155-c19f-4a24-ae6e-68c8cafa760e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:24.460478 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672e155-c19f-4a24-ae6e-68c8cafa760e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.462033 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672e155-c19f-4a24-ae6e-68c8cafa760e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.462033 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672e155-c19f-4a24-ae6e-68c8cafa760e None admin] PATH_INFO: `/v3/users/5b24fddf649e4ed58d13e5de21990398` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.462379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672e155-c19f-4a24-ae6e-68c8cafa760e None admin] RBAC: Authorizing `identity:get_user(user_id=5b24fddf649e4ed58d13e5de21990398)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:24.463828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672e155-c19f-4a24-ae6e-68c8cafa760e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:24.465443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 57/116] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:24 2022] GET /identity/v3/users/5b24fddf649e4ed58d13e5de21990398 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:24.466212 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672e155-c19f-4a24-ae6e-68c8cafa760e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:24.503814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 60/117] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:24.504675 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e52e57-bedf-46c3-a834-bd58de625b5e None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:24.509398 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:24.586528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:24.592833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672e155-c19f-4a24-ae6e-68c8cafa760e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:24.616680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e52e57-bedf-46c3-a834-bd58de625b5e None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:24.628631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d3a59-1ffa-4b04-b90e-d30538508dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:24.629324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d3a59-1ffa-4b04-b90e-d30538508dcc None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.629604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d3a59-1ffa-4b04-b90e-d30538508dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.629878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d3a59-1ffa-4b04-b90e-d30538508dcc None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672/users/5b24fddf649e4ed58d13e5de21990398/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.631948 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d3a59-1ffa-4b04-b90e-d30538508dcc None admin] RBAC: Authorizing `identity:create_grant(project_id=85dec1bdd87547f7b0d6bdc818811672, user_id=5b24fddf649e4ed58d13e5de21990398, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:24.633874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d3a59-1ffa-4b04-b90e-d30538508dcc None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:24.650732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 58/118] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:09:24 2022] PUT /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672/users/5b24fddf649e4ed58d13e5de21990398/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:09:24.651601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d3a59-1ffa-4b04-b90e-d30538508dcc None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:24.680470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039d964-d816-4fc0-9576-156152f3e855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:24.681525 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d964-d816-4fc0-9576-156152f3e855 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.681987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d964-d816-4fc0-9576-156152f3e855 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.682428 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039d964-d816-4fc0-9576-156152f3e855 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.683309 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039d964-d816-4fc0-9576-156152f3e855 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:24.683832 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039d964-d816-4fc0-9576-156152f3e855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:24.685547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039d964-d816-4fc0-9576-156152f3e855 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:24.696446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 61/119] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:24.697773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039d964-d816-4fc0-9576-156152f3e855 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:24.778491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:24.789136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d3a59-1ffa-4b04-b90e-d30538508dcc None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:24.830192 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039d964-d816-4fc0-9576-156152f3e855 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:24.831051 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213b394-dc1b-442f-bfd4-c5f8e985553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:24.831814 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213b394-dc1b-442f-bfd4-c5f8e985553a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.832108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213b394-dc1b-442f-bfd4-c5f8e985553a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.832393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213b394-dc1b-442f-bfd4-c5f8e985553a None admin] PATH_INFO: `/v3/users/49badb585471458d8eee65c32db51bee` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.849728 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213b394-dc1b-442f-bfd4-c5f8e985553a None admin] RBAC: Authorizing `identity:get_user(user_id=49badb585471458d8eee65c32db51bee)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:24.851154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213b394-dc1b-442f-bfd4-c5f8e985553a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:24.853036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 59/120] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:24 2022] GET /identity/v3/users/49badb585471458d8eee65c32db51bee => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:24.858372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213b394-dc1b-442f-bfd4-c5f8e985553a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:24.868054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63627f-cf1a-4523-92f0-75b195977fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:24.868712 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63627f-cf1a-4523-92f0-75b195977fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.869004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63627f-cf1a-4523-92f0-75b195977fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.869655 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63627f-cf1a-4523-92f0-75b195977fd0 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.871198 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63627f-cf1a-4523-92f0-75b195977fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:24.872840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63627f-cf1a-4523-92f0-75b195977fd0 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:24.875047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 62/121] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:24 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:24.876133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2015aa-d42d-48df-8858-feedb8350e87 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:24.876423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2015aa-d42d-48df-8858-feedb8350e87 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:24.876710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2015aa-d42d-48df-8858-feedb8350e87 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:24.882249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 63/122] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:24.882249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2015aa-d42d-48df-8858-feedb8350e87 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:24.884046 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:24.978835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213b394-dc1b-442f-bfd4-c5f8e985553a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:24.995189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2015aa-d42d-48df-8858-feedb8350e87 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:25.018092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e5fd4-6b21-4279-851b-5ac22a6e0799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:25.019036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e5fd4-6b21-4279-851b-5ac22a6e0799 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:25.019326 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e5fd4-6b21-4279-851b-5ac22a6e0799 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:25.019602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e5fd4-6b21-4279-851b-5ac22a6e0799 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:25.021265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e5fd4-6b21-4279-851b-5ac22a6e0799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:25.022751 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e5fd4-6b21-4279-851b-5ac22a6e0799 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:25.028991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 60/123] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:25.028991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e5fd4-6b21-4279-851b-5ac22a6e0799 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:25.037069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347100bd-be92-41c6-a4ac-312dbb362c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:25.037881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347100bd-be92-41c6-a4ac-312dbb362c2f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:25.038196 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347100bd-be92-41c6-a4ac-312dbb362c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:25.038475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347100bd-be92-41c6-a4ac-312dbb362c2f None admin] PATH_INFO: `/v3/users/48e73f0688f64fae87f2adc4e4e25455` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:25.039913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347100bd-be92-41c6-a4ac-312dbb362c2f None admin] RBAC: Authorizing `identity:get_user(user_id=48e73f0688f64fae87f2adc4e4e25455)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:25.041674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347100bd-be92-41c6-a4ac-312dbb362c2f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:25.043926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 64/124] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:24 2022] GET /identity/v3/users/48e73f0688f64fae87f2adc4e4e25455 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:25.044679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347100bd-be92-41c6-a4ac-312dbb362c2f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:25.056607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:25.130751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:25.143323 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e5fd4-6b21-4279-851b-5ac22a6e0799 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:25.172361 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347100bd-be92-41c6-a4ac-312dbb362c2f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:25.181202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49568478-5c64-4e3d-ab9c-41fcba107479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:25.181838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49568478-5c64-4e3d-ab9c-41fcba107479 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:25.182163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49568478-5c64-4e3d-ab9c-41fcba107479 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:25.182444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49568478-5c64-4e3d-ab9c-41fcba107479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:25.212100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a65902-9086-4713-b5dd-d0a89a881ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:25.212783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65902-9086-4713-b5dd-d0a89a881ccc None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:25.213067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65902-9086-4713-b5dd-d0a89a881ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:25.213348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a65902-9086-4713-b5dd-d0a89a881ccc None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672/users/5b24fddf649e4ed58d13e5de21990398/roles/e1f4e92f38534e1d80123b0beaa2be47` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:25.215613 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a65902-9086-4713-b5dd-d0a89a881ccc None admin] RBAC: Authorizing `identity:create_grant(project_id=85dec1bdd87547f7b0d6bdc818811672, user_id=5b24fddf649e4ed58d13e5de21990398, role_id=e1f4e92f38534e1d80123b0beaa2be47)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:25.217051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a65902-9086-4713-b5dd-d0a89a881ccc None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:25.230877 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 65/125] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:09:25 2022] PUT /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672/users/5b24fddf649e4ed58d13e5de21990398/roles/e1f4e92f38534e1d80123b0beaa2be47 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:09:25.232542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1f57-6b9e-41e0-a58c-bda3db1a4031 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:25.233060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1f57-6b9e-41e0-a58c-bda3db1a4031 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:25.233547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1f57-6b9e-41e0-a58c-bda3db1a4031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:25.256148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-e99b1f57-6b9e-41e0-a58c-bda3db1a4031 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:25.258890 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e99b1f57-6b9e-41e0-a58c-bda3db1a4031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:25.273196 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49568478-5c64-4e3d-ab9c-41fcba107479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:25.275130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49568478-5c64-4e3d-ab9c-41fcba107479 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:25.304815 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:25.374473 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 66/126] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:25.375972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b1f57-6b9e-41e0-a58c-bda3db1a4031 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:25.423630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 61/127] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:25.424241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49568478-5c64-4e3d-ab9c-41fcba107479 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:25.452180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:25.501901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b1f57-6b9e-41e0-a58c-bda3db1a4031 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:25.542824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57ffd1-9b9d-4e69-93d0-635a7e6cd27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:25.543458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ffd1-9b9d-4e69-93d0-635a7e6cd27e None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:25.543740 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ffd1-9b9d-4e69-93d0-635a7e6cd27e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:25.544019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ffd1-9b9d-4e69-93d0-635a7e6cd27e None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:25.544809 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57ffd1-9b9d-4e69-93d0-635a7e6cd27e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:25.546421 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57ffd1-9b9d-4e69-93d0-635a7e6cd27e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:25.573238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49568478-5c64-4e3d-ab9c-41fcba107479 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:25.580769 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 67/128] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:09:25 2022] POST /identity/v3/projects => generated 302 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:25.587226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57ffd1-9b9d-4e69-93d0-635a7e6cd27e None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:25.602972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:25.613721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cd695-c42e-4fec-92b7-6c49f9423bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:25.614665 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cd695-c42e-4fec-92b7-6c49f9423bab None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:25.615053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cd695-c42e-4fec-92b7-6c49f9423bab None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:25.615443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cd695-c42e-4fec-92b7-6c49f9423bab None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:25.616728 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cd695-c42e-4fec-92b7-6c49f9423bab None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:25.618352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cd695-c42e-4fec-92b7-6c49f9423bab None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:25.620505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 62/129] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:25 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:25.621171 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cd695-c42e-4fec-92b7-6c49f9423bab None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:25.755867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cd695-c42e-4fec-92b7-6c49f9423bab None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:25.799612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633d1ec-4ca2-471d-851c-6b9c5b407072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:25.800497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d1ec-4ca2-471d-851c-6b9c5b407072 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:25.800885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d1ec-4ca2-471d-851c-6b9c5b407072 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:25.801264 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d1ec-4ca2-471d-851c-6b9c5b407072 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:25.801530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57ffd1-9b9d-4e69-93d0-635a7e6cd27e None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:25.811183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633d1ec-4ca2-471d-851c-6b9c5b407072 None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:25.816405 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633d1ec-4ca2-471d-851c-6b9c5b407072 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:25.816405 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 63/130] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:25 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:25.816701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633d1ec-4ca2-471d-851c-6b9c5b407072 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:25.835715 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:25.903414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:25.909157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2219941-2e71-492c-b919-00a6d18acb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:25.909821 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2219941-2e71-492c-b919-00a6d18acb06 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:25.910251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2219941-2e71-492c-b919-00a6d18acb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:25.913482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2219941-2e71-492c-b919-00a6d18acb06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:25.933947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2219941-2e71-492c-b919-00a6d18acb06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-e2219941-2e71-492c-b919-00a6d18acb06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:25.941283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:25.942447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:25.943273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 68/131] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:25.943939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2219941-2e71-492c-b919-00a6d18acb06 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:25.969218 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633d1ec-4ca2-471d-851c-6b9c5b407072 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:26.026106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864e736-3c1e-4bc3-9b77-a66eb19d3511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:26.027633 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e736-3c1e-4bc3-9b77-a66eb19d3511 None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:26.028244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e736-3c1e-4bc3-9b77-a66eb19d3511 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:26.028731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864e736-3c1e-4bc3-9b77-a66eb19d3511 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672/users/48e73f0688f64fae87f2adc4e4e25455/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:26.031135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864e736-3c1e-4bc3-9b77-a66eb19d3511 None admin] RBAC: Authorizing `identity:create_grant(project_id=85dec1bdd87547f7b0d6bdc818811672, user_id=48e73f0688f64fae87f2adc4e4e25455, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:26.032989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864e736-3c1e-4bc3-9b77-a66eb19d3511 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:26.052019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 64/132] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:09:25 2022] PUT /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672/users/48e73f0688f64fae87f2adc4e4e25455/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:09:26.053365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864e736-3c1e-4bc3-9b77-a66eb19d3511 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:26.057227 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2219941-2e71-492c-b919-00a6d18acb06 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:26.096397 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5c1ff-0541-4a03-a87f-a1c36c5ee8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:26.097035 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c1ff-0541-4a03-a87f-a1c36c5ee8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:26.097316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c1ff-0541-4a03-a87f-a1c36c5ee8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:26.097593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5c1ff-0541-4a03-a87f-a1c36c5ee8a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:26.098566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5c1ff-0541-4a03-a87f-a1c36c5ee8a8 None admin] RBAC: Adding query filter params (role.id=39c9e7be022744fc9a349364ef6ce2d0, scope.project.id=85dec1bdd87547f7b0d6bdc818811672, user.id=49badb585471458d8eee65c32db51bee) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:26.098801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5c1ff-0541-4a03-a87f-a1c36c5ee8a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:26.100537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5c1ff-0541-4a03-a87f-a1c36c5ee8a8 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:26.106726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 69/133] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:25 2022] GET /identity/v3/role_assignments?user.id=49badb585471458d8eee65c32db51bee&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=39c9e7be022744fc9a349364ef6ce2d0 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:26.186453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864e736-3c1e-4bc3-9b77-a66eb19d3511 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:26.209560 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:26.230128 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5fdd-05aa-4214-bfea-9f7860d9d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:26.231216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5fdd-05aa-4214-bfea-9f7860d9d6ed None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:26.231718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5fdd-05aa-4214-bfea-9f7860d9d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:26.232197 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c5fdd-05aa-4214-bfea-9f7860d9d6ed None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:26.233250 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5fdd-05aa-4214-bfea-9f7860d9d6ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:26.233789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5fdd-05aa-4214-bfea-9f7860d9d6ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:26.236014 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c5fdd-05aa-4214-bfea-9f7860d9d6ed None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:26.247355 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 65/134] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:26.256168 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5c1ff-0541-4a03-a87f-a1c36c5ee8a8 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:26.318416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:26.388915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5c1ff-0541-4a03-a87f-a1c36c5ee8a8 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:26.429795 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55bbb6-4413-4bad-a693-be9ca6a6ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:26.430440 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55bbb6-4413-4bad-a693-be9ca6a6ef01 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:26.430723 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55bbb6-4413-4bad-a693-be9ca6a6ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:26.431006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55bbb6-4413-4bad-a693-be9ca6a6ef01 None admin] PATH_INFO: `/v3/users/5b24fddf649e4ed58d13e5de21990398` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:26.432265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55bbb6-4413-4bad-a693-be9ca6a6ef01 None admin] RBAC: Authorizing `identity:get_user(user_id=5b24fddf649e4ed58d13e5de21990398)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:26.434222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55bbb6-4413-4bad-a693-be9ca6a6ef01 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:26.435903 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 70/135] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:26 2022] GET /identity/v3/users/5b24fddf649e4ed58d13e5de21990398 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:26.444251 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5fdd-05aa-4214-bfea-9f7860d9d6ed None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:26.608602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c5fdd-05aa-4214-bfea-9f7860d9d6ed None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:26.689214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35919fe7-9eeb-4615-914c-e62fd18e5ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:26.690353 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919fe7-9eeb-4615-914c-e62fd18e5ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:26.690860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919fe7-9eeb-4615-914c-e62fd18e5ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:26.691361 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919fe7-9eeb-4615-914c-e62fd18e5ee7 None admin] PATH_INFO: `/v3/projects/27209056e4aa4fb49aa5c2a72a016bec` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:26.695172 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35919fe7-9eeb-4615-914c-e62fd18e5ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=27209056e4aa4fb49aa5c2a72a016bec)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:26.697810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35919fe7-9eeb-4615-914c-e62fd18e5ee7 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:26.701186 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 66/136] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:26 2022] GET /identity/v3/projects/27209056e4aa4fb49aa5c2a72a016bec => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:26.707158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55bbb6-4413-4bad-a693-be9ca6a6ef01 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:26.875349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55bbb6-4413-4bad-a693-be9ca6a6ef01 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:26.906439 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:26.932043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e1fd4-5776-4e6d-811f-9a45b5bc3946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:26.932737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e1fd4-5776-4e6d-811f-9a45b5bc3946 None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:26.933022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e1fd4-5776-4e6d-811f-9a45b5bc3946 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:26.933303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e1fd4-5776-4e6d-811f-9a45b5bc3946 None admin] PATH_INFO: `/v3/projects/27209056e4aa4fb49aa5c2a72a016bec/users/5b24fddf649e4ed58d13e5de21990398/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:26.935364 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e1fd4-5776-4e6d-811f-9a45b5bc3946 None admin] RBAC: Authorizing `identity:create_grant(project_id=27209056e4aa4fb49aa5c2a72a016bec, user_id=5b24fddf649e4ed58d13e5de21990398, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:26.936817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e1fd4-5776-4e6d-811f-9a45b5bc3946 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:26.961751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 71/137] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:09:26 2022] PUT /identity/v3/projects/27209056e4aa4fb49aa5c2a72a016bec/users/5b24fddf649e4ed58d13e5de21990398/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:09:27.456656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094820b5-5d85-40df-a552-d4f203bd6401 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:27.457230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094820b5-5d85-40df-a552-d4f203bd6401 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:27.457619 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094820b5-5d85-40df-a552-d4f203bd6401 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:27.460285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 67/138] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:27.466173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e9a9-17e0-42df-a722-691175f831aa None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:27.466641 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e9a9-17e0-42df-a722-691175f831aa None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:27.466731 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040e9a9-17e0-42df-a722-691175f831aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:27.489590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-6040e9a9-17e0-42df-a722-691175f831aa None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:27.490812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-6040e9a9-17e0-42df-a722-691175f831aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:27.591980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 72/139] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:27.629548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094820b5-5d85-40df-a552-d4f203bd6401 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:27.698387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:27.779223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094820b5-5d85-40df-a552-d4f203bd6401 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:27.845160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134243c-5b28-4ced-99a9-53ee1c841110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:27.846191 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134243c-5b28-4ced-99a9-53ee1c841110 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:27.846709 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134243c-5b28-4ced-99a9-53ee1c841110 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:27.847236 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134243c-5b28-4ced-99a9-53ee1c841110 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:27.870924 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134243c-5b28-4ced-99a9-53ee1c841110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-1134243c-5b28-4ced-99a9-53ee1c841110 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:27.877689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:27.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:27.879413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:27.881867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 68/140] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:27.887935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040e9a9-17e0-42df-a722-691175f831aa None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:28.066548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:28.072423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040e9a9-17e0-42df-a722-691175f831aa None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:28.121112 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c700be-8a93-4de6-bf73-ffab5fcebe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:28.121754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c700be-8a93-4de6-bf73-ffab5fcebe49 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:28.122056 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c700be-8a93-4de6-bf73-ffab5fcebe49 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:28.122342 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c700be-8a93-4de6-bf73-ffab5fcebe49 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:28.123079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c700be-8a93-4de6-bf73-ffab5fcebe49 None admin] RBAC: Adding query filter params (name=member) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:28.123401 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c700be-8a93-4de6-bf73-ffab5fcebe49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:28.124801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c700be-8a93-4de6-bf73-ffab5fcebe49 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:28.137766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 73/141] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:28.143981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134243c-5b28-4ced-99a9-53ee1c841110 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:28.311985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134243c-5b28-4ced-99a9-53ee1c841110 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:28.322219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:28.370800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bac563-4d73-4af5-ad0e-3d42de3b0087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:28.371481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bac563-4d73-4af5-ad0e-3d42de3b0087 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:28.371771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bac563-4d73-4af5-ad0e-3d42de3b0087 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:28.372052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bac563-4d73-4af5-ad0e-3d42de3b0087 None admin] PATH_INFO: `/v3/users/5b24fddf649e4ed58d13e5de21990398` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:28.373293 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bac563-4d73-4af5-ad0e-3d42de3b0087 None admin] RBAC: Authorizing `identity:get_user(user_id=5b24fddf649e4ed58d13e5de21990398)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:28.374762 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bac563-4d73-4af5-ad0e-3d42de3b0087 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:28.376703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 69/142] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:28 2022] GET /identity/v3/users/5b24fddf649e4ed58d13e5de21990398 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:28.382053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c700be-8a93-4de6-bf73-ffab5fcebe49 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:28.497247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c700be-8a93-4de6-bf73-ffab5fcebe49 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:28.533906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128c2f8-7407-49a9-9b6c-9b867fb2e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:28.534563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c2f8-7407-49a9-9b6c-9b867fb2e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:28.534845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c2f8-7407-49a9-9b6c-9b867fb2e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:28.535122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c2f8-7407-49a9-9b6c-9b867fb2e0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:28.564367 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:28.619086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128c2f8-7407-49a9-9b6c-9b867fb2e0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:28.621097 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128c2f8-7407-49a9-9b6c-9b867fb2e0d1 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:28.754260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 74/143] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:28.759132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bac563-4d73-4af5-ad0e-3d42de3b0087 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:28.872989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315483a5-949e-4837-b6d6-2702bb5be6ee None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:28.873304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315483a5-949e-4837-b6d6-2702bb5be6ee None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:28.873555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315483a5-949e-4837-b6d6-2702bb5be6ee None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:28.874979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 75/144] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:28.880622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431893b-fdd2-44e7-a38a-4634651d9528 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:28.881105 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431893b-fdd2-44e7-a38a-4634651d9528 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:28.881595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431893b-fdd2-44e7-a38a-4634651d9528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:28.919355 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-2431893b-fdd2-44e7-a38a-4634651d9528 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:28.920771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-2431893b-fdd2-44e7-a38a-4634651d9528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:28.928524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bac563-4d73-4af5-ad0e-3d42de3b0087 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:29.000504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e379bc7-e0dd-456e-9a6c-4c3b5f0b880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:29.001222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e379bc7-e0dd-456e-9a6c-4c3b5f0b880c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.001507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e379bc7-e0dd-456e-9a6c-4c3b5f0b880c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.001783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e379bc7-e0dd-456e-9a6c-4c3b5f0b880c None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.003008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e379bc7-e0dd-456e-9a6c-4c3b5f0b880c None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:29.004539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e379bc7-e0dd-456e-9a6c-4c3b5f0b880c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:29.006500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 70/145] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:28 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:29.014400 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e379bc7-e0dd-456e-9a6c-4c3b5f0b880c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:29.053504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:29.084916 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:29.087960 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 76/146] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:29.128688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431893b-fdd2-44e7-a38a-4634651d9528 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:29.152905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e379bc7-e0dd-456e-9a6c-4c3b5f0b880c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:29.190579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2d3cb-2ea4-464a-bddd-46868c5c6e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:29.191217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2d3cb-2ea4-464a-bddd-46868c5c6e40 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.191501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2d3cb-2ea4-464a-bddd-46868c5c6e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.191778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2d3cb-2ea4-464a-bddd-46868c5c6e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.194043 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2d3cb-2ea4-464a-bddd-46868c5c6e40 None admin] RBAC: Adding query filter params (role.id=a4aae8b3b8b4486389006b0d25566eb6, scope.project.id=85dec1bdd87547f7b0d6bdc818811672, user.id=5b24fddf649e4ed58d13e5de21990398) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:29.194043 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2d3cb-2ea4-464a-bddd-46868c5c6e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:29.194550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2d3cb-2ea4-464a-bddd-46868c5c6e40 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:29.202248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 71/147] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:29 2022] GET /identity/v3/role_assignments?user.id=5b24fddf649e4ed58d13e5de21990398&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:29.204319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384d795-09f9-49ab-aaea-dbcf867183d1 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.204726 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384d795-09f9-49ab-aaea-dbcf867183d1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.205010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384d795-09f9-49ab-aaea-dbcf867183d1 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.206579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 72/148] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:29.213933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fbbc8-30ce-4fe3-a000-1eedf29d59df None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.213933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fbbc8-30ce-4fe3-a000-1eedf29d59df None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.213933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fbbc8-30ce-4fe3-a000-1eedf29d59df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.249030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-261fbbc8-30ce-4fe3-a000-1eedf29d59df None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:29.252135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-261fbbc8-30ce-4fe3-a000-1eedf29d59df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:29.328621 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431893b-fdd2-44e7-a38a-4634651d9528 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:29.387964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 73/149] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:29.408020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cf9fe-533c-43d1-84f1-775e2ec99a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:29.408697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cf9fe-533c-43d1-84f1-775e2ec99a46 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.408974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cf9fe-533c-43d1-84f1-775e2ec99a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.409250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cf9fe-533c-43d1-84f1-775e2ec99a46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.425504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fbbc8-30ce-4fe3-a000-1eedf29d59df None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:29.436858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cf9fe-533c-43d1-84f1-775e2ec99a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-658cf9fe-533c-43d1-84f1-775e2ec99a46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:29.453474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:29.455018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:29.455796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:29.457175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 77/150] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:09:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:29.472616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cf9fe-533c-43d1-84f1-775e2ec99a46 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:29.503606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:29.593572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:29.602040 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fbbc8-30ce-4fe3-a000-1eedf29d59df None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:29.671554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06ef8-8746-40b3-9982-d792139b9831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:29.672238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06ef8-8746-40b3-9982-d792139b9831 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.672538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06ef8-8746-40b3-9982-d792139b9831 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.672972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae06ef8-8746-40b3-9982-d792139b9831 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.674348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae06ef8-8746-40b3-9982-d792139b9831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:29.675818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae06ef8-8746-40b3-9982-d792139b9831 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:29.677596 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 74/151] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:29.682640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cf9fe-533c-43d1-84f1-775e2ec99a46 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:29.685016 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06ef8-8746-40b3-9982-d792139b9831 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:29.741499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99056345-4eb7-4a30-963c-25cc0353b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:29.742174 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99056345-4eb7-4a30-963c-25cc0353b814 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.742460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99056345-4eb7-4a30-963c-25cc0353b814 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.742736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99056345-4eb7-4a30-963c-25cc0353b814 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.743475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99056345-4eb7-4a30-963c-25cc0353b814 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:29.743782 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99056345-4eb7-4a30-963c-25cc0353b814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:29.745188 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99056345-4eb7-4a30-963c-25cc0353b814 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:29.756139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 78/152] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:09:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:29.758244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff869d-e2eb-4230-9b57-481f97f848a2 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.758600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff869d-e2eb-4230-9b57-481f97f848a2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.759000 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff869d-e2eb-4230-9b57-481f97f848a2 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.761431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 79/153] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:29.762246 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff869d-e2eb-4230-9b57-481f97f848a2 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:29.825966 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae06ef8-8746-40b3-9982-d792139b9831 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:29.835284 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:29.870606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e647aa-52c5-41dc-8406-58b2a5e5b869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:29.871159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e647aa-52c5-41dc-8406-58b2a5e5b869 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.871697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e647aa-52c5-41dc-8406-58b2a5e5b869 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.871982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e647aa-52c5-41dc-8406-58b2a5e5b869 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.873371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e647aa-52c5-41dc-8406-58b2a5e5b869 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:29.875263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e647aa-52c5-41dc-8406-58b2a5e5b869 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:29.880677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff869d-e2eb-4230-9b57-481f97f848a2 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:29.892818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:29.902467 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 75/154] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:09:29 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:29.904185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa53b-4db8-4b61-b178-2fb8a8f48477 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.904499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa53b-4db8-4b61-b178-2fb8a8f48477 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.904760 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa53b-4db8-4b61-b178-2fb8a8f48477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.927277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb229089-c665-4421-899f-7b350bd65008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:29.928480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229089-c665-4421-899f-7b350bd65008 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.928938 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229089-c665-4421-899f-7b350bd65008 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.929386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229089-c665-4421-899f-7b350bd65008 None admin] PATH_INFO: `/v3/users/5b24fddf649e4ed58d13e5de21990398` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.931893 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb229089-c665-4421-899f-7b350bd65008 None admin] RBAC: Authorizing `identity:get_user(user_id=5b24fddf649e4ed58d13e5de21990398)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:29.934065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb229089-c665-4421-899f-7b350bd65008 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:29.935087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-deeaa53b-4db8-4b61-b178-2fb8a8f48477 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:29.936489 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 80/155] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:29 2022] GET /identity/v3/users/5b24fddf649e4ed58d13e5de21990398 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:29.936612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-deeaa53b-4db8-4b61-b178-2fb8a8f48477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:29.938258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138cd8-d1b4-473c-9a68-267d48d38121 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:29.939223 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138cd8-d1b4-473c-9a68-267d48d38121 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:29.939896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138cd8-d1b4-473c-9a68-267d48d38121 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:29.941765 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 81/156] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:29.949907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138cd8-d1b4-473c-9a68-267d48d38121 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:30.029422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 76/157] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:30.030770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be48c08-17c1-4ccc-9f9d-51b2ee8deb12 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:30.031056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be48c08-17c1-4ccc-9f9d-51b2ee8deb12 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:30.031339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be48c08-17c1-4ccc-9f9d-51b2ee8deb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:30.050886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6be48c08-17c1-4ccc-9f9d-51b2ee8deb12 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:30.052104 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6be48c08-17c1-4ccc-9f9d-51b2ee8deb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:30.090914 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138cd8-d1b4-473c-9a68-267d48d38121 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:30.134309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 77/158] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:30.135491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be48c08-17c1-4ccc-9f9d-51b2ee8deb12 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:30.136544 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfe15f-67eb-4c12-a268-1bdfd82344c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:30.137205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfe15f-67eb-4c12-a268-1bdfd82344c4 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:30.137492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfe15f-67eb-4c12-a268-1bdfd82344c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:30.137765 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfe15f-67eb-4c12-a268-1bdfd82344c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:30.179958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:30.205859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:30.234047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfe15f-67eb-4c12-a268-1bdfd82344c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:30.236135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfe15f-67eb-4c12-a268-1bdfd82344c4 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:30.288791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be48c08-17c1-4ccc-9f9d-51b2ee8deb12 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:30.336115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ec2d9-a948-4ff9-a9af-b1b91e19819e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:30.336796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec2d9-a948-4ff9-a9af-b1b91e19819e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:30.337088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec2d9-a948-4ff9-a9af-b1b91e19819e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:30.337367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ec2d9-a948-4ff9-a9af-b1b91e19819e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:30.356920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ec2d9-a948-4ff9-a9af-b1b91e19819e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-472ec2d9-a948-4ff9-a9af-b1b91e19819e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:30.362732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:30.363885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:30.364656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 78/159] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:09:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:30.365300 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ec2d9-a948-4ff9-a9af-b1b91e19819e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:30.388941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 82/160] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:30.390687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348dc9-8f14-4bad-8c5a-e5895ef32da9 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:30.390979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348dc9-8f14-4bad-8c5a-e5895ef32da9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:30.391301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348dc9-8f14-4bad-8c5a-e5895ef32da9 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:30.393091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 83/161] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:30.394185 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53348dc9-8f14-4bad-8c5a-e5895ef32da9 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:30.488728 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:30.514301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:30.519365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ec2d9-a948-4ff9-a9af-b1b91e19819e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:30.546256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53348dc9-8f14-4bad-8c5a-e5895ef32da9 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:30.563540 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd41cf-7d87-4648-b438-a5160e322a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:30.564549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd41cf-7d87-4648-b438-a5160e322a50 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:30.565032 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd41cf-7d87-4648-b438-a5160e322a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:30.565505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd41cf-7d87-4648-b438-a5160e322a50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:30.582575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd41cf-7d87-4648-b438-a5160e322a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-54fd41cf-7d87-4648-b438-a5160e322a50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:30.589718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:30.590858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:30.591655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:30.592256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98824a32-f385-44ad-909e-548f99ab39b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:30.592256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98824a32-f385-44ad-909e-548f99ab39b3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:30.592256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98824a32-f385-44ad-909e-548f99ab39b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:30.592926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98824a32-f385-44ad-909e-548f99ab39b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:30.593291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98824a32-f385-44ad-909e-548f99ab39b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:30.593606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98824a32-f385-44ad-909e-548f99ab39b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:30.595549 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98824a32-f385-44ad-909e-548f99ab39b3 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:30.597132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 79/162] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:30.598680 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd41cf-7d87-4648-b438-a5160e322a50 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:30.611882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 84/163] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:30.612976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14db34-2f80-4d41-826d-6616dc4e9a96 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:30.613267 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14db34-2f80-4d41-826d-6616dc4e9a96 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:30.613542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14db34-2f80-4d41-826d-6616dc4e9a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:30.641683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-2e14db34-2f80-4d41-826d-6616dc4e9a96 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:30.643481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-2e14db34-2f80-4d41-826d-6616dc4e9a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:30.764552 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd41cf-7d87-4648-b438-a5160e322a50 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:30.767733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 85/164] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:30.770545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14db34-2f80-4d41-826d-6616dc4e9a96 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:30.820442 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a8013-9aef-40c8-9c53-7a07ba4db98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:30.826706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a8013-9aef-40c8-9c53-7a07ba4db98b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:30.827297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a8013-9aef-40c8-9c53-7a07ba4db98b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:30.827297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a8013-9aef-40c8-9c53-7a07ba4db98b None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:30.828589 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a8013-9aef-40c8-9c53-7a07ba4db98b None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:30.830701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a8013-9aef-40c8-9c53-7a07ba4db98b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:30.832422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 80/165] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:30 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:30.833212 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a8013-9aef-40c8-9c53-7a07ba4db98b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:30.853710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:30.957134 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:31.011392 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14db34-2f80-4d41-826d-6616dc4e9a96 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:31.028384 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a8013-9aef-40c8-9c53-7a07ba4db98b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:31.090027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0824e-4636-4d04-b5b5-2dede3e5378e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:31.090659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0824e-4636-4d04-b5b5-2dede3e5378e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:31.090939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0824e-4636-4d04-b5b5-2dede3e5378e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:31.091210 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0824e-4636-4d04-b5b5-2dede3e5378e None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:31.091945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0824e-4636-4d04-b5b5-2dede3e5378e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:31.092250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0824e-4636-4d04-b5b5-2dede3e5378e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:31.093663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0824e-4636-4d04-b5b5-2dede3e5378e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:31.103569 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d3191-dd44-4040-ac66-4daab6271f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:31.104231 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d3191-dd44-4040-ac66-4daab6271f8f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:31.104511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d3191-dd44-4040-ac66-4daab6271f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:31.104783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d3191-dd44-4040-ac66-4daab6271f8f None admin] PATH_INFO: `/v3/users/48e73f0688f64fae87f2adc4e4e25455` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:31.107003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d3191-dd44-4040-ac66-4daab6271f8f None admin] RBAC: Authorizing `identity:get_user(user_id=48e73f0688f64fae87f2adc4e4e25455)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:31.108440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d3191-dd44-4040-ac66-4daab6271f8f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:31.110324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 81/166] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:30 2022] GET /identity/v3/users/48e73f0688f64fae87f2adc4e4e25455 => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:31.110935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d3191-dd44-4040-ac66-4daab6271f8f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:31.113436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 86/167] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:31.114290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0824e-4636-4d04-b5b5-2dede3e5378e None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:31.237526 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0824e-4636-4d04-b5b5-2dede3e5378e None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:31.274439 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:31.287530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1091f-b580-467e-9032-d57e677aff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:31.288531 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1091f-b580-467e-9032-d57e677aff0a None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:31.289005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1091f-b580-467e-9032-d57e677aff0a None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:31.289467 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1091f-b580-467e-9032-d57e677aff0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:31.290551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1091f-b580-467e-9032-d57e677aff0a None admin] RBAC: Adding query filter params (role.id=e1f4e92f38534e1d80123b0beaa2be47, scope.project.id=85dec1bdd87547f7b0d6bdc818811672, user.id=5b24fddf649e4ed58d13e5de21990398) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:31.293626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1091f-b580-467e-9032-d57e677aff0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:31.295357 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1091f-b580-467e-9032-d57e677aff0a None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:31.301855 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:31.304583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 87/168] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:31 2022] GET /identity/v3/role_assignments?user.id=5b24fddf649e4ed58d13e5de21990398&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=e1f4e92f38534e1d80123b0beaa2be47 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:31.305745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1091f-b580-467e-9032-d57e677aff0a None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:31.364045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d3191-dd44-4040-ac66-4daab6271f8f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:31.455903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e956817-67e7-4360-bd19-0dff56784602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:31.457059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956817-67e7-4360-bd19-0dff56784602 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:31.457647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956817-67e7-4360-bd19-0dff56784602 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:31.458149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e956817-67e7-4360-bd19-0dff56784602 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:31.475662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e956817-67e7-4360-bd19-0dff56784602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-5e956817-67e7-4360-bd19-0dff56784602 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:31.481483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:31.482530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:31.483325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 82/169] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:31.484458 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e956817-67e7-4360-bd19-0dff56784602 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:31.584331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1091f-b580-467e-9032-d57e677aff0a None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:31.608628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e956817-67e7-4360-bd19-0dff56784602 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:31.638939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5332aa-ca71-4aa3-bf95-27f103cf01b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:31.639697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5332aa-ca71-4aa3-bf95-27f103cf01b0 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:31.639863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5332aa-ca71-4aa3-bf95-27f103cf01b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:31.640145 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5332aa-ca71-4aa3-bf95-27f103cf01b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:31.650488 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677216-90be-460f-b805-174feace0cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:31.651569 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677216-90be-460f-b805-174feace0cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:31.652078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677216-90be-460f-b805-174feace0cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:31.652550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15677216-90be-460f-b805-174feace0cc5 None admin] PATH_INFO: `/v3/users/49badb585471458d8eee65c32db51bee` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:31.654308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15677216-90be-460f-b805-174feace0cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=49badb585471458d8eee65c32db51bee)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:31.656242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15677216-90be-460f-b805-174feace0cc5 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:31.659330 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 83/170] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:31 2022] GET /identity/v3/users/49badb585471458d8eee65c32db51bee => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:31.665211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677216-90be-460f-b805-174feace0cc5 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:31.678280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:31.724341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:31.728159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5332aa-ca71-4aa3-bf95-27f103cf01b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:31.729694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5332aa-ca71-4aa3-bf95-27f103cf01b0 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:31.842344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15677216-90be-460f-b805-174feace0cc5 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:31.879495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 88/171] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:31.880446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5332aa-ca71-4aa3-bf95-27f103cf01b0 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:31.914582 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698311f6-2b2a-4e48-abfb-f883c078840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:31.915411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698311f6-2b2a-4e48-abfb-f883c078840b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:31.915726 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698311f6-2b2a-4e48-abfb-f883c078840b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:31.916033 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698311f6-2b2a-4e48-abfb-f883c078840b None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:31.917072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698311f6-2b2a-4e48-abfb-f883c078840b None admin] RBAC: Adding query filter params (name=member) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:31.917524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698311f6-2b2a-4e48-abfb-f883c078840b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:31.919068 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698311f6-2b2a-4e48-abfb-f883c078840b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:31.937119 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 84/172] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:31.938060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698311f6-2b2a-4e48-abfb-f883c078840b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:31.992021 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:31.998494 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5332aa-ca71-4aa3-bf95-27f103cf01b0 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:32.034537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278bac-4bfb-421c-9192-11ec7c932c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:32.035236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278bac-4bfb-421c-9192-11ec7c932c06 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:32.035528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278bac-4bfb-421c-9192-11ec7c932c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:32.035808 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278bac-4bfb-421c-9192-11ec7c932c06 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:32.037029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278bac-4bfb-421c-9192-11ec7c932c06 None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:32.038524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278bac-4bfb-421c-9192-11ec7c932c06 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:32.040575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 89/173] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:31 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:32.041626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278bac-4bfb-421c-9192-11ec7c932c06 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:32.135133 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:32.151084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278bac-4bfb-421c-9192-11ec7c932c06 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:32.188475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e47c8-619b-4a03-a92b-e06c1431416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:32.189132 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e47c8-619b-4a03-a92b-e06c1431416c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:32.189417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e47c8-619b-4a03-a92b-e06c1431416c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:32.189697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e47c8-619b-4a03-a92b-e06c1431416c None admin] PATH_INFO: `/v3/users/5b24fddf649e4ed58d13e5de21990398` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:32.190952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e47c8-619b-4a03-a92b-e06c1431416c None admin] RBAC: Authorizing `identity:get_user(user_id=5b24fddf649e4ed58d13e5de21990398)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:32.192431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e47c8-619b-4a03-a92b-e06c1431416c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:32.194459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 90/174] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:32 2022] GET /identity/v3/users/5b24fddf649e4ed58d13e5de21990398 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:32.195300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e47c8-619b-4a03-a92b-e06c1431416c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:32.228031 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698311f6-2b2a-4e48-abfb-f883c078840b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:32.270441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:32.312415 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e47c8-619b-4a03-a92b-e06c1431416c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:32.366967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991d55-7ccf-439c-8c22-6516458f60b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:32.367846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b8bcf-4e99-4bee-80bd-bbd910a4fb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:32.368676 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991d55-7ccf-439c-8c22-6516458f60b1 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:32.369493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b8bcf-4e99-4bee-80bd-bbd910a4fb6d None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:32.369920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991d55-7ccf-439c-8c22-6516458f60b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:32.370384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b8bcf-4e99-4bee-80bd-bbd910a4fb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:32.370806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991d55-7ccf-439c-8c22-6516458f60b1 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:32.371213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b8bcf-4e99-4bee-80bd-bbd910a4fb6d None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672/users/49badb585471458d8eee65c32db51bee/roles/39c9e7be022744fc9a349364ef6ce2d0` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:32.373478 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26991d55-7ccf-439c-8c22-6516458f60b1 None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:32.375742 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26991d55-7ccf-439c-8c22-6516458f60b1 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:32.377151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b8bcf-4e99-4bee-80bd-bbd910a4fb6d None admin] RBAC: Authorizing `identity:create_grant(project_id=85dec1bdd87547f7b0d6bdc818811672, user_id=49badb585471458d8eee65c32db51bee, role_id=39c9e7be022744fc9a349364ef6ce2d0)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:32.378748 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b8bcf-4e99-4bee-80bd-bbd910a4fb6d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:32.386411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 85/175] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:31 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:32.387525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991d55-7ccf-439c-8c22-6516458f60b1 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:32.418976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 91/176] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:09:32 2022] PUT /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672/users/49badb585471458d8eee65c32db51bee/roles/39c9e7be022744fc9a349364ef6ce2d0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:09:32.420099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b8bcf-4e99-4bee-80bd-bbd910a4fb6d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:32.557425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991d55-7ccf-439c-8c22-6516458f60b1 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:32.600736 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ad048-f2b8-4ce6-9737-50d71bc85254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:32.601541 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ad048-f2b8-4ce6-9737-50d71bc85254 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:32.601921 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ad048-f2b8-4ce6-9737-50d71bc85254 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:32.606048 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ad048-f2b8-4ce6-9737-50d71bc85254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:32.634414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:32.698899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ad048-f2b8-4ce6-9737-50d71bc85254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:32.700868 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ad048-f2b8-4ce6-9737-50d71bc85254 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:32.727146 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:32.763722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b8bcf-4e99-4bee-80bd-bbd910a4fb6d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:32.814824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a664f6-9181-4ae5-8b2c-04eae5b2b301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:32.815589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a664f6-9181-4ae5-8b2c-04eae5b2b301 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:32.815868 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a664f6-9181-4ae5-8b2c-04eae5b2b301 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:32.816142 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a664f6-9181-4ae5-8b2c-04eae5b2b301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:32.817214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a664f6-9181-4ae5-8b2c-04eae5b2b301 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=85dec1bdd87547f7b0d6bdc818811672, user.id=48e73f0688f64fae87f2adc4e4e25455) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:32.818062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a664f6-9181-4ae5-8b2c-04eae5b2b301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:32.819677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a664f6-9181-4ae5-8b2c-04eae5b2b301 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:32.831345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 92/177] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:32 2022] GET /identity/v3/role_assignments?user.id=48e73f0688f64fae87f2adc4e4e25455&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 608 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:32.832760 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4c06-8d2d-4018-8642-258acaf8cec6 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:32.833045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4c06-8d2d-4018-8642-258acaf8cec6 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:32.833320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4c06-8d2d-4018-8642-258acaf8cec6 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:32.833845 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 86/178] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:32.835113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 93/179] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:32.842831 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4c06-8d2d-4018-8642-258acaf8cec6 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:32.843331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fec54-dd3e-4a76-a0cd-7d83860e6b32 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:32.843783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fec54-dd3e-4a76-a0cd-7d83860e6b32 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:32.843965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fec54-dd3e-4a76-a0cd-7d83860e6b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:32.887724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-7f9fec54-dd3e-4a76-a0cd-7d83860e6b32 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:32.889573 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7f9fec54-dd3e-4a76-a0cd-7d83860e6b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:32.960244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:32.994828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4c06-8d2d-4018-8642-258acaf8cec6 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:33.050577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 87/180] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:33.052023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410afb6-b315-4081-ac27-65971b1634e7 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.052301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410afb6-b315-4081-ac27-65971b1634e7 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.052622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410afb6-b315-4081-ac27-65971b1634e7 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.053979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 88/181] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:33.061319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252262a-589d-4163-8211-d711972f1211 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.061645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252262a-589d-4163-8211-d711972f1211 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.061885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252262a-589d-4163-8211-d711972f1211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.071098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573cdce-3b29-4568-bc35-4a360fd495f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:33.071988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573cdce-3b29-4568-bc35-4a360fd495f2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.072276 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573cdce-3b29-4568-bc35-4a360fd495f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.072557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573cdce-3b29-4568-bc35-4a360fd495f2 None admin] PATH_INFO: `/v3/projects/27209056e4aa4fb49aa5c2a72a016bec` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.075797 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573cdce-3b29-4568-bc35-4a360fd495f2 None admin] RBAC: Authorizing `identity:get_project(project_id=27209056e4aa4fb49aa5c2a72a016bec)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:33.077284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573cdce-3b29-4568-bc35-4a360fd495f2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:33.080695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 94/182] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:32 2022] GET /identity/v3/projects/27209056e4aa4fb49aa5c2a72a016bec => generated 312 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:33.087670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0268d-85b4-419c-9acf-b4def1b50e16 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.087972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0268d-85b4-419c-9acf-b4def1b50e16 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.088227 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0268d-85b4-419c-9acf-b4def1b50e16 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.089583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 95/183] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:33.090307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0268d-85b4-419c-9acf-b4def1b50e16 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:33.099292 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3252262a-589d-4163-8211-d711972f1211 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:33.100436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3252262a-589d-4163-8211-d711972f1211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:33.140000 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:33.197901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 89/184] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:33.197901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b4c6e-0749-4fc5-8bbc-00bae3b9d470 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.197901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b4c6e-0749-4fc5-8bbc-00bae3b9d470 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.197901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b4c6e-0749-4fc5-8bbc-00bae3b9d470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.224306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-845b4c6e-0749-4fc5-8bbc-00bae3b9d470 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:33.225438 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-845b4c6e-0749-4fc5-8bbc-00bae3b9d470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:33.243646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d0268d-85b4-419c-9acf-b4def1b50e16 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:33.284570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e177340-0d73-4e6f-8b48-6548d2ff4b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:33.285197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e177340-0d73-4e6f-8b48-6548d2ff4b29 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.285479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e177340-0d73-4e6f-8b48-6548d2ff4b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.285752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e177340-0d73-4e6f-8b48-6548d2ff4b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.286598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e177340-0d73-4e6f-8b48-6548d2ff4b29 None admin] RBAC: Adding query filter params (role.id=a4aae8b3b8b4486389006b0d25566eb6, scope.project.id=27209056e4aa4fb49aa5c2a72a016bec, user.id=5b24fddf649e4ed58d13e5de21990398) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:33.286928 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e177340-0d73-4e6f-8b48-6548d2ff4b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:33.288359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e177340-0d73-4e6f-8b48-6548d2ff4b29 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:33.295071 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 96/185] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:33 2022] GET /identity/v3/role_assignments?user.id=5b24fddf649e4ed58d13e5de21990398&scope.project.id=27209056e4aa4fb49aa5c2a72a016bec&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:33.295881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e177340-0d73-4e6f-8b48-6548d2ff4b29 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:33.324246 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 90/186] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:33.326034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b4c6e-0749-4fc5-8bbc-00bae3b9d470 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:33.365980 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:33.410406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:33.428413 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e177340-0d73-4e6f-8b48-6548d2ff4b29 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:33.470307 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b4c6e-0749-4fc5-8bbc-00bae3b9d470 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:33.477866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bc6aa-4901-461e-87b3-87ecaacc96dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:33.478626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc6aa-4901-461e-87b3-87ecaacc96dc None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.479002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc6aa-4901-461e-87b3-87ecaacc96dc None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.479374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc6aa-4901-461e-87b3-87ecaacc96dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.496726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bc6aa-4901-461e-87b3-87ecaacc96dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-3c5bc6aa-4901-461e-87b3-87ecaacc96dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:33.503072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:33.504002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:33.504799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:33.510051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 97/187] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:09:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:33.510051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bc6aa-4901-461e-87b3-87ecaacc96dc None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:33.524583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba0ccc-a2e3-4fd9-a888-f207117a9cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:33.525254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba0ccc-a2e3-4fd9-a888-f207117a9cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.525983 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba0ccc-a2e3-4fd9-a888-f207117a9cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.526294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba0ccc-a2e3-4fd9-a888-f207117a9cd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.528151 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba0ccc-a2e3-4fd9-a888-f207117a9cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:33.529624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba0ccc-a2e3-4fd9-a888-f207117a9cd4 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:33.534123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 91/188] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:33.534123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba0ccc-a2e3-4fd9-a888-f207117a9cd4 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:33.653759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bc6aa-4901-461e-87b3-87ecaacc96dc None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:33.658461 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:33.667647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba0ccc-a2e3-4fd9-a888-f207117a9cd4 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:33.696659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde5b9-f4e6-4531-a4b5-0d6cab7e3000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:33.697316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde5b9-f4e6-4531-a4b5-0d6cab7e3000 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.700656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde5b9-f4e6-4531-a4b5-0d6cab7e3000 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.700656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde5b9-f4e6-4531-a4b5-0d6cab7e3000 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.712179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dde5b9-f4e6-4531-a4b5-0d6cab7e3000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:33.712391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1041b2c-55a1-44ae-86a1-2f0b1493c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:33.712839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1041b2c-55a1-44ae-86a1-2f0b1493c19e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.713123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1041b2c-55a1-44ae-86a1-2f0b1493c19e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.713397 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1041b2c-55a1-44ae-86a1-2f0b1493c19e None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.714253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1041b2c-55a1-44ae-86a1-2f0b1493c19e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:33.714564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1041b2c-55a1-44ae-86a1-2f0b1493c19e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:33.715943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1041b2c-55a1-44ae-86a1-2f0b1493c19e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-93dde5b9-f4e6-4531-a4b5-0d6cab7e3000 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:33.718601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:33.719553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 98/189] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:09:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:33.722595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde5b9-f4e6-4531-a4b5-0d6cab7e3000 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:33.736515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 92/190] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:09:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:33.736515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1041b2c-55a1-44ae-86a1-2f0b1493c19e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:33.737600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:33.853973 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde5b9-f4e6-4531-a4b5-0d6cab7e3000 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:33.857905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1041b2c-55a1-44ae-86a1-2f0b1493c19e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:33.892665 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d96bb-33dd-4d01-a8aa-d2958a66096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:33.893369 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d96bb-33dd-4d01-a8aa-d2958a66096b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.893649 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d96bb-33dd-4d01-a8aa-d2958a66096b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.893921 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d96bb-33dd-4d01-a8aa-d2958a66096b None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.894687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d96bb-33dd-4d01-a8aa-d2958a66096b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:33.895036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d96bb-33dd-4d01-a8aa-d2958a66096b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:33.896456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d96bb-33dd-4d01-a8aa-d2958a66096b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:33.900786 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f56a-fecb-48db-8ce2-6ebf39e7f03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:33.901676 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f56a-fecb-48db-8ce2-6ebf39e7f03f None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:33.902581 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f56a-fecb-48db-8ce2-6ebf39e7f03f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:33.903023 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f56a-fecb-48db-8ce2-6ebf39e7f03f None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:33.904127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9f56a-fecb-48db-8ce2-6ebf39e7f03f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:33.905292 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 93/191] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:33.905909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9f56a-fecb-48db-8ce2-6ebf39e7f03f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:33.906151 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d96bb-33dd-4d01-a8aa-d2958a66096b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:33.932909 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:33.940941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 99/192] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:09:33 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:33.942041 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f56a-fecb-48db-8ce2-6ebf39e7f03f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:34.025649 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:34.073320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f56a-fecb-48db-8ce2-6ebf39e7f03f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:34.077214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d96bb-33dd-4d01-a8aa-d2958a66096b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:34.114364 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0797cc-8ec0-465a-946c-7f77c2babea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:34.115227 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0797cc-8ec0-465a-946c-7f77c2babea1 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:34.115611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0797cc-8ec0-465a-946c-7f77c2babea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:34.115981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0797cc-8ec0-465a-946c-7f77c2babea1 None admin] PATH_INFO: `/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:34.127640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523915e-0e4c-4b12-ba2e-b96880f2aa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:34.128902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523915e-0e4c-4b12-ba2e-b96880f2aa1b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:34.129336 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523915e-0e4c-4b12-ba2e-b96880f2aa1b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:34.130355 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523915e-0e4c-4b12-ba2e-b96880f2aa1b None admin] PATH_INFO: `/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:34.132613 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0797cc-8ec0-465a-946c-7f77c2babea1 None admin] RBAC: Authorizing `identity:get_user(user_id=7bcd730eb0154e48ba9837a11cf6dbfa)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:34.135152 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0797cc-8ec0-465a-946c-7f77c2babea1 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:34.136665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 100/193] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:33 2022] GET /identity/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:34.144906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0797cc-8ec0-465a-946c-7f77c2babea1 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:34.148463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523915e-0e4c-4b12-ba2e-b96880f2aa1b None admin] RBAC: Authorizing `identity:get_user(user_id=7bcd730eb0154e48ba9837a11cf6dbfa)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:34.150564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523915e-0e4c-4b12-ba2e-b96880f2aa1b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:34.152705 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 94/194] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:33 2022] GET /identity/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:34.160542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523915e-0e4c-4b12-ba2e-b96880f2aa1b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:34.261511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:34.291975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0797cc-8ec0-465a-946c-7f77c2babea1 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:34.296214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523915e-0e4c-4b12-ba2e-b96880f2aa1b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:34.337853 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6fec4-a17b-486f-aa3e-43df9a667866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:34.339678 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:34.340246 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6fec4-a17b-486f-aa3e-43df9a667866 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:34.341014 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6fec4-a17b-486f-aa3e-43df9a667866 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:34.342734 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6fec4-a17b-486f-aa3e-43df9a667866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:34.362762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdce90-80cd-47bd-ba9a-cc525d22948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:34.363435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdce90-80cd-47bd-ba9a-cc525d22948d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:34.363716 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdce90-80cd-47bd-ba9a-cc525d22948d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:34.363993 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdce90-80cd-47bd-ba9a-cc525d22948d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:34.448045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6fec4-a17b-486f-aa3e-43df9a667866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:34.450071 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6fec4-a17b-486f-aa3e-43df9a667866 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:34.453946 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdce90-80cd-47bd-ba9a-cc525d22948d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:34.456060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdce90-80cd-47bd-ba9a-cc525d22948d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:34.574220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:34.605383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 95/195] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:09:34.612180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6fec4-a17b-486f-aa3e-43df9a667866 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:34.633220 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 101/196] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:34.639481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdce90-80cd-47bd-ba9a-cc525d22948d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:34.697084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:34.792654 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6fec4-a17b-486f-aa3e-43df9a667866 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:34.843332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdce90-80cd-47bd-ba9a-cc525d22948d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:34.848060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037494-dd5c-4d8b-8c33-d1bc8acc541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:34.848653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037494-dd5c-4d8b-8c33-d1bc8acc541b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:34.848935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037494-dd5c-4d8b-8c33-d1bc8acc541b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:34.849213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b037494-dd5c-4d8b-8c33-d1bc8acc541b None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:34.857463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b037494-dd5c-4d8b-8c33-d1bc8acc541b None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:34.859317 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b037494-dd5c-4d8b-8c33-d1bc8acc541b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:34.864899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 96/197] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:34 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:34.870778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037494-dd5c-4d8b-8c33-d1bc8acc541b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:34.917346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf804d7-02b4-42c5-8607-6f30f750a090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:34.918421 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf804d7-02b4-42c5-8607-6f30f750a090 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:34.918896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf804d7-02b4-42c5-8607-6f30f750a090 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:34.919359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf804d7-02b4-42c5-8607-6f30f750a090 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:34.920750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf804d7-02b4-42c5-8607-6f30f750a090 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:34.923076 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf804d7-02b4-42c5-8607-6f30f750a090 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:34.925670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 102/198] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:34 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:34.938359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf804d7-02b4-42c5-8607-6f30f750a090 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:34.974438 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:35.029236 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b037494-dd5c-4d8b-8c33-d1bc8acc541b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:35.062478 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:35.071924 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3ee02-9725-4057-96ec-9ec2faa62bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:35.072894 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3ee02-9725-4057-96ec-9ec2faa62bee None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:35.073366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf804d7-02b4-42c5-8607-6f30f750a090 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:35.073483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3ee02-9725-4057-96ec-9ec2faa62bee None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:35.073939 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3ee02-9725-4057-96ec-9ec2faa62bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:35.074936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3ee02-9725-4057-96ec-9ec2faa62bee None admin] RBAC: Adding query filter params (role.id=e1f4e92f38534e1d80123b0beaa2be47, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96, user.id=7bcd730eb0154e48ba9837a11cf6dbfa) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:35.075574 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3ee02-9725-4057-96ec-9ec2faa62bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:35.078152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3ee02-9725-4057-96ec-9ec2faa62bee None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:35.087514 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 97/199] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:34 2022] GET /identity/v3/role_assignments?user.id=7bcd730eb0154e48ba9837a11cf6dbfa&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=e1f4e92f38534e1d80123b0beaa2be47 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:35.089775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430ab7-351f-4205-b71e-45ea8367b125 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:35.090319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430ab7-351f-4205-b71e-45ea8367b125 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:35.090973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a430ab7-351f-4205-b71e-45ea8367b125 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:35.098555 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 98/200] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:35.099862 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7355fa-4ccb-47e3-a9f0-f36593ed9253 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:35.100143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7355fa-4ccb-47e3-a9f0-f36593ed9253 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:35.100414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7355fa-4ccb-47e3-a9f0-f36593ed9253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:35.120810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-fe7355fa-4ccb-47e3-a9f0-f36593ed9253 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:35.122516 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-fe7355fa-4ccb-47e3-a9f0-f36593ed9253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:35.128889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd196e-f98b-4808-85f5-9e8663a851d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:35.131069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd196e-f98b-4808-85f5-9e8663a851d9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:35.135548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd196e-f98b-4808-85f5-9e8663a851d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:35.136074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd196e-f98b-4808-85f5-9e8663a851d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:35.137143 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd196e-f98b-4808-85f5-9e8663a851d9 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96, user.id=7bcd730eb0154e48ba9837a11cf6dbfa) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:35.138718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd196e-f98b-4808-85f5-9e8663a851d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:35.140819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd196e-f98b-4808-85f5-9e8663a851d9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:35.154039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 103/201] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:34 2022] GET /identity/v3/role_assignments?user.id=7bcd730eb0154e48ba9837a11cf6dbfa&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:35.224096 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 99/202] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:35.248059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd196e-f98b-4808-85f5-9e8663a851d9 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:35.384302 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd196e-f98b-4808-85f5-9e8663a851d9 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:35.426454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82845c75-438e-4fb7-aa66-15c0616ba25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:35.427116 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82845c75-438e-4fb7-aa66-15c0616ba25c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:35.427402 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82845c75-438e-4fb7-aa66-15c0616ba25c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:35.427681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82845c75-438e-4fb7-aa66-15c0616ba25c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:35.439534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82845c75-438e-4fb7-aa66-15c0616ba25c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-82845c75-438e-4fb7-aa66-15c0616ba25c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:35.446875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:35.448235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:35.449705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 104/203] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:35.457308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7355fa-4ccb-47e3-a9f0-f36593ed9253 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:35.505923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:35.587593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7355fa-4ccb-47e3-a9f0-f36593ed9253 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:35.647333 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46311542-5451-4a06-bb5f-23b9bcd2bb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:35.647906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46311542-5451-4a06-bb5f-23b9bcd2bb1c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:35.648190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46311542-5451-4a06-bb5f-23b9bcd2bb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:35.648475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46311542-5451-4a06-bb5f-23b9bcd2bb1c None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:35.649313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46311542-5451-4a06-bb5f-23b9bcd2bb1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:35.649633 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46311542-5451-4a06-bb5f-23b9bcd2bb1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:35.651115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46311542-5451-4a06-bb5f-23b9bcd2bb1c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:35.664603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 100/204] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:35.670502 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82845c75-438e-4fb7-aa66-15c0616ba25c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:35.691516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:35.807139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82845c75-438e-4fb7-aa66-15c0616ba25c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:35.859858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d46ab-a163-478b-ab2c-c4aafdbe4938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:35.861264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d46ab-a163-478b-ab2c-c4aafdbe4938 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:35.861604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d46ab-a163-478b-ab2c-c4aafdbe4938 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:35.861884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d46ab-a163-478b-ab2c-c4aafdbe4938 None admin] PATH_INFO: `/v3/users/49badb585471458d8eee65c32db51bee` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:35.866723 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d46ab-a163-478b-ab2c-c4aafdbe4938 None admin] RBAC: Authorizing `identity:get_user(user_id=49badb585471458d8eee65c32db51bee)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:35.868206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d46ab-a163-478b-ab2c-c4aafdbe4938 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:35.870072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 105/205] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:35 2022] GET /identity/v3/users/49badb585471458d8eee65c32db51bee => generated 289 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:35.875507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46311542-5451-4a06-bb5f-23b9bcd2bb1c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:36.012187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:36.015121 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46311542-5451-4a06-bb5f-23b9bcd2bb1c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:36.066264 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd5dc9-2c3d-4b28-9d36-fccb4ad014cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:36.066907 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd5dc9-2c3d-4b28-9d36-fccb4ad014cd None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:36.067194 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd5dc9-2c3d-4b28-9d36-fccb4ad014cd None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:36.067472 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd5dc9-2c3d-4b28-9d36-fccb4ad014cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:36.169790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd5dc9-2c3d-4b28-9d36-fccb4ad014cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:36.171305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd5dc9-2c3d-4b28-9d36-fccb4ad014cd None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:36.300235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:36.303969 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 101/206] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:36.315096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d46ab-a163-478b-ab2c-c4aafdbe4938 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:36.457080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:36.480417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d46ab-a163-478b-ab2c-c4aafdbe4938 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:36.517590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70eb6f-a4d5-4a6f-8282-f831c55a1d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:36.518277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70eb6f-a4d5-4a6f-8282-f831c55a1d6a None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:36.518563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70eb6f-a4d5-4a6f-8282-f831c55a1d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:36.518842 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70eb6f-a4d5-4a6f-8282-f831c55a1d6a None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:36.520061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70eb6f-a4d5-4a6f-8282-f831c55a1d6a None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:36.521609 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70eb6f-a4d5-4a6f-8282-f831c55a1d6a None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:36.523664 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 106/207] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:36 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:36.529588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd5dc9-2c3d-4b28-9d36-fccb4ad014cd None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:36.666085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd5dc9-2c3d-4b28-9d36-fccb4ad014cd None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:36.706836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178c7ee-73e9-4f8a-8d69-0533d516d3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:36.707886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c7ee-73e9-4f8a-8d69-0533d516d3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:36.708381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c7ee-73e9-4f8a-8d69-0533d516d3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:36.708878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178c7ee-73e9-4f8a-8d69-0533d516d3c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:36.709885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178c7ee-73e9-4f8a-8d69-0533d516d3c0 None admin] RBAC: Adding query filter params (role.id=39c9e7be022744fc9a349364ef6ce2d0, scope.project.id=85dec1bdd87547f7b0d6bdc818811672, user.id=49badb585471458d8eee65c32db51bee) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:36.710231 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178c7ee-73e9-4f8a-8d69-0533d516d3c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:36.711689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178c7ee-73e9-4f8a-8d69-0533d516d3c0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:36.718220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 102/208] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:36 2022] GET /identity/v3/role_assignments?user.id=49badb585471458d8eee65c32db51bee&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=39c9e7be022744fc9a349364ef6ce2d0 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:36.917087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b48f-004a-4d56-8b3a-fd9476b850dc None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:36.917615 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b48f-004a-4d56-8b3a-fd9476b850dc None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:36.917823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b48f-004a-4d56-8b3a-fd9476b850dc None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:36.919736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 107/209] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:36.925559 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6f382-1451-419e-96bc-f2eb6daf87b9 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:36.926110 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6f382-1451-419e-96bc-f2eb6daf87b9 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:36.926399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6f382-1451-419e-96bc-f2eb6daf87b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:36.955366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-66b6f382-1451-419e-96bc-f2eb6daf87b9 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:36.956601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-66b6f382-1451-419e-96bc-f2eb6daf87b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:37.040996 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:37.057643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 103/210] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:37.071888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83686eac-acf0-43a7-8b4f-136421d896f6 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.072221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83686eac-acf0-43a7-8b4f-136421d896f6 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.072460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83686eac-acf0-43a7-8b4f-136421d896f6 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.074068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 108/211] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:37.080153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4c439-9663-4ed5-959b-f0f669e7d739 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.080443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4c439-9663-4ed5-959b-f0f669e7d739 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.080727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4c439-9663-4ed5-959b-f0f669e7d739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.094915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83686eac-acf0-43a7-8b4f-136421d896f6 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:37.105152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6bd4c439-9663-4ed5-959b-f0f669e7d739 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:37.107896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6bd4c439-9663-4ed5-959b-f0f669e7d739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:37.194563 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 104/212] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:37.225959 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4c439-9663-4ed5-959b-f0f669e7d739 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:37.236993 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83686eac-acf0-43a7-8b4f-136421d896f6 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:37.279768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dcca2-355a-4ad8-a107-5f661a44b38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:37.280432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dcca2-355a-4ad8-a107-5f661a44b38b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.280720 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dcca2-355a-4ad8-a107-5f661a44b38b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.280995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dcca2-355a-4ad8-a107-5f661a44b38b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.294192 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dcca2-355a-4ad8-a107-5f661a44b38b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-247dcca2-355a-4ad8-a107-5f661a44b38b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:37.300917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:37.301822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:37.302659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 109/213] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:37.308192 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dcca2-355a-4ad8-a107-5f661a44b38b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:37.321873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:37.358504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4c439-9663-4ed5-959b-f0f669e7d739 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:37.387231 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:37.401459 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c144ec-5b1a-4983-8a25-680e0082c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:37.402185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c144ec-5b1a-4983-8a25-680e0082c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.402905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c144ec-5b1a-4983-8a25-680e0082c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.403189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c144ec-5b1a-4983-8a25-680e0082c0f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.404352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c144ec-5b1a-4983-8a25-680e0082c0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:37.405923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c144ec-5b1a-4983-8a25-680e0082c0f3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:37.408346 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 105/214] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:37.414934 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c144ec-5b1a-4983-8a25-680e0082c0f3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:37.434156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dcca2-355a-4ad8-a107-5f661a44b38b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:37.479854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d4920-9434-48b8-9eea-a944fadea288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:37.480815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d4920-9434-48b8-9eea-a944fadea288 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.481318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d4920-9434-48b8-9eea-a944fadea288 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.481892 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d4920-9434-48b8-9eea-a944fadea288 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.482971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d4920-9434-48b8-9eea-a944fadea288 None admin] RBAC: Adding query filter params (name=member) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:37.483480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d4920-9434-48b8-9eea-a944fadea288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:37.485304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d4920-9434-48b8-9eea-a944fadea288 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:37.495071 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 110/215] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:37.500978 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d4920-9434-48b8-9eea-a944fadea288 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:37.533889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c144ec-5b1a-4983-8a25-680e0082c0f3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:37.572475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63289a0-9c78-4687-b224-3105caede982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:37.573101 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63289a0-9c78-4687-b224-3105caede982 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.573383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63289a0-9c78-4687-b224-3105caede982 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.573650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63289a0-9c78-4687-b224-3105caede982 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.574618 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63289a0-9c78-4687-b224-3105caede982 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:37.576352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63289a0-9c78-4687-b224-3105caede982 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:37.583584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:37.606124 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 106/216] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:09:37 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:37.627992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d4920-9434-48b8-9eea-a944fadea288 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:37.671049 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc51075-c50d-42da-8028-27c74921acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:37.672482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51075-c50d-42da-8028-27c74921acea None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.673030 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51075-c50d-42da-8028-27c74921acea None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.673516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc51075-c50d-42da-8028-27c74921acea None admin] PATH_INFO: `/v3/users/aad91e24194548f3b699fed072d7bcf3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.676916 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5559c-5da3-4835-a2eb-f0a1835dd47b None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.677227 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5559c-5da3-4835-a2eb-f0a1835dd47b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.677477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5559c-5da3-4835-a2eb-f0a1835dd47b None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.679780 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 107/217] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:37.691671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4936c54-3b50-4c6f-b820-3c6ae8e5547d None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.692014 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4936c54-3b50-4c6f-b820-3c6ae8e5547d None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.692267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4936c54-3b50-4c6f-b820-3c6ae8e5547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.697341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc51075-c50d-42da-8028-27c74921acea None admin] RBAC: Authorizing `identity:get_user(user_id=aad91e24194548f3b699fed072d7bcf3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:37.699465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc51075-c50d-42da-8028-27c74921acea None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:37.701619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 111/218] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:37 2022] GET /identity/v3/users/aad91e24194548f3b699fed072d7bcf3 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:37.708390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc51075-c50d-42da-8028-27c74921acea None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:37.714862 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-c4936c54-3b50-4c6f-b820-3c6ae8e5547d None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:37.716587 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c4936c54-3b50-4c6f-b820-3c6ae8e5547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:37.783671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:37.815081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 108/219] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:37.818255 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1cf7-2339-4eb2-a2bc-687f1beeb6a7 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.818255 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1cf7-2339-4eb2-a2bc-687f1beeb6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.818255 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1cf7-2339-4eb2-a2bc-687f1beeb6a7 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.819223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 109/220] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:37.825102 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf648b4-246f-48a4-b009-fbdcc3baf074 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.825409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf648b4-246f-48a4-b009-fbdcc3baf074 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.825649 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf648b4-246f-48a4-b009-fbdcc3baf074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.846958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-edf648b4-246f-48a4-b009-fbdcc3baf074 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:37.848499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-edf648b4-246f-48a4-b009-fbdcc3baf074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:37.851983 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc51075-c50d-42da-8028-27c74921acea None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:37.899895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:37.909315 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed0014-cd7c-4258-be69-9747f71c7f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:37.910176 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed0014-cd7c-4258-be69-9747f71c7f53 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:37.910462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed0014-cd7c-4258-be69-9747f71c7f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:37.910738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed0014-cd7c-4258-be69-9747f71c7f53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:37.954315 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 110/221] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:37.955336 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf648b4-246f-48a4-b009-fbdcc3baf074 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:38.016249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed0014-cd7c-4258-be69-9747f71c7f53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:38.019173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed0014-cd7c-4258-be69-9747f71c7f53 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:38.087314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf648b4-246f-48a4-b009-fbdcc3baf074 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:38.099357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:38.127532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0a0d7-082f-454b-82f6-0a0b892bdb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:38.127904 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0a0d7-082f-454b-82f6-0a0b892bdb57 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:38.128169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0a0d7-082f-454b-82f6-0a0b892bdb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:38.128444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0a0d7-082f-454b-82f6-0a0b892bdb57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:38.142186 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0a0d7-082f-454b-82f6-0a0b892bdb57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-d6f0a0d7-082f-454b-82f6-0a0b892bdb57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:38.147820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:38.148831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:38.149777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:38.150432 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 111/222] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:09:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:38.150977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0a0d7-082f-454b-82f6-0a0b892bdb57 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:38.163261 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 112/223] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:09:38.164452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed0014-cd7c-4258-be69-9747f71c7f53 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:38.199306 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:38.270035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0a0d7-082f-454b-82f6-0a0b892bdb57 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:38.277021 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed0014-cd7c-4258-be69-9747f71c7f53 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:38.320781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fec0c-5224-4ad8-9d7e-810c87cd66e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:38.321451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fec0c-5224-4ad8-9d7e-810c87cd66e8 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:38.321737 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fec0c-5224-4ad8-9d7e-810c87cd66e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:38.322141 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fec0c-5224-4ad8-9d7e-810c87cd66e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:38.323386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eafdb-61fd-4e00-b23f-67fcbdc47efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:38.324216 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eafdb-61fd-4e00-b23f-67fcbdc47efe None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:38.324685 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eafdb-61fd-4e00-b23f-67fcbdc47efe None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:38.325177 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83eafdb-61fd-4e00-b23f-67fcbdc47efe None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:38.326115 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eafdb-61fd-4e00-b23f-67fcbdc47efe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:38.326610 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eafdb-61fd-4e00-b23f-67fcbdc47efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:38.328217 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83eafdb-61fd-4e00-b23f-67fcbdc47efe None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:38.334914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fec0c-5224-4ad8-9d7e-810c87cd66e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:38.339056 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 113/224] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:38.340212 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eafdb-61fd-4e00-b23f-67fcbdc47efe None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-d15fec0c-5224-4ad8-9d7e-810c87cd66e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:38.341875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:38.342768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:38.343547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 112/225] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:09:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:38.357366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fec0c-5224-4ad8-9d7e-810c87cd66e8 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:38.394673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:38.443258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:38.452882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83eafdb-61fd-4e00-b23f-67fcbdc47efe None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:38.482426 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fec0c-5224-4ad8-9d7e-810c87cd66e8 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:38.489655 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd3f65-d0e5-46cf-a712-e41bb5fdc7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:38.490656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd3f65-d0e5-46cf-a712-e41bb5fdc7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:38.491130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd3f65-d0e5-46cf-a712-e41bb5fdc7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:38.491580 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd3f65-d0e5-46cf-a712-e41bb5fdc7d6 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:38.492958 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd3f65-d0e5-46cf-a712-e41bb5fdc7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:38.494638 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd3f65-d0e5-46cf-a712-e41bb5fdc7d6 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:38.496836 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 114/226] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:38 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:38.497816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd3f65-d0e5-46cf-a712-e41bb5fdc7d6 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:38.530571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197bb94-e584-4ac6-bcad-e1ffb676d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:38.531261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197bb94-e584-4ac6-bcad-e1ffb676d3cd None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:38.531544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197bb94-e584-4ac6-bcad-e1ffb676d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:38.532346 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197bb94-e584-4ac6-bcad-e1ffb676d3cd None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:38.533322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197bb94-e584-4ac6-bcad-e1ffb676d3cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:38.533630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197bb94-e584-4ac6-bcad-e1ffb676d3cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:38.535821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197bb94-e584-4ac6-bcad-e1ffb676d3cd None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:38.551991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 113/227] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:09:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:38.552701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197bb94-e584-4ac6-bcad-e1ffb676d3cd None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:38.627709 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd3f65-d0e5-46cf-a712-e41bb5fdc7d6 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:38.663566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cc815-02a0-4f0e-a515-57dce0300817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:38.664247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc815-02a0-4f0e-a515-57dce0300817 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:38.664920 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc815-02a0-4f0e-a515-57dce0300817 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:38.664920 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cc815-02a0-4f0e-a515-57dce0300817 None admin] PATH_INFO: `/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:38.666041 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cc815-02a0-4f0e-a515-57dce0300817 None admin] RBAC: Authorizing `identity:get_user(user_id=7bcd730eb0154e48ba9837a11cf6dbfa)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:38.667746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cc815-02a0-4f0e-a515-57dce0300817 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:38.668512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:38.669473 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 115/228] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:38 2022] GET /identity/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:38.674308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cc815-02a0-4f0e-a515-57dce0300817 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:38.681884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197bb94-e584-4ac6-bcad-e1ffb676d3cd None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:38.708020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:38.723682 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e120d5-464f-4f53-b4fa-4bccb40d10c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:38.724773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e120d5-464f-4f53-b4fa-4bccb40d10c5 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:38.725273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e120d5-464f-4f53-b4fa-4bccb40d10c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:38.725776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e120d5-464f-4f53-b4fa-4bccb40d10c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:38.726821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e120d5-464f-4f53-b4fa-4bccb40d10c5 None admin] RBAC: Adding query filter params (role.id=a4aae8b3b8b4486389006b0d25566eb6, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96, user.id=aad91e24194548f3b699fed072d7bcf3) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:38.727433 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e120d5-464f-4f53-b4fa-4bccb40d10c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:38.729185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e120d5-464f-4f53-b4fa-4bccb40d10c5 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:38.741730 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 114/229] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:38 2022] GET /identity/v3/role_assignments?user.id=aad91e24194548f3b699fed072d7bcf3&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:38.743365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e120d5-464f-4f53-b4fa-4bccb40d10c5 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:38.787419 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cc815-02a0-4f0e-a515-57dce0300817 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:38.825887 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a6431-fce7-4fee-af25-0edb1b313a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:38.826579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6431-fce7-4fee-af25-0edb1b313a37 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:38.826867 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6431-fce7-4fee-af25-0edb1b313a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:38.827148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a6431-fce7-4fee-af25-0edb1b313a37 None admin] PATH_INFO: `/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:38.829015 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a6431-fce7-4fee-af25-0edb1b313a37 None admin] RBAC: Authorizing `identity:get_user(user_id=7bcd730eb0154e48ba9837a11cf6dbfa)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:38.830601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a6431-fce7-4fee-af25-0edb1b313a37 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:38.832303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 116/230] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:38 2022] GET /identity/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:38.840739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a6431-fce7-4fee-af25-0edb1b313a37 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:38.872080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e120d5-464f-4f53-b4fa-4bccb40d10c5 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:38.913428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc10e00-d63f-4fce-9b3a-1cb9a8e9d5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:38.914474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc10e00-d63f-4fce-9b3a-1cb9a8e9d5ac None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:38.914983 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc10e00-d63f-4fce-9b3a-1cb9a8e9d5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:38.915553 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc10e00-d63f-4fce-9b3a-1cb9a8e9d5ac None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:38.917432 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc10e00-d63f-4fce-9b3a-1cb9a8e9d5ac None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:38.919273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc10e00-d63f-4fce-9b3a-1cb9a8e9d5ac None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:38.921612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 115/231] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:38 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:38.931313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc10e00-d63f-4fce-9b3a-1cb9a8e9d5ac None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:38.975301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:38.981624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:38.989826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a6431-fce7-4fee-af25-0edb1b313a37 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:39.032425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f939743-3679-41cb-9737-daa1df61b800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:39.033763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f939743-3679-41cb-9737-daa1df61b800 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:39.034453 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f939743-3679-41cb-9737-daa1df61b800 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:39.034922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f939743-3679-41cb-9737-daa1df61b800 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:39.036530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f939743-3679-41cb-9737-daa1df61b800 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:39.038743 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f939743-3679-41cb-9737-daa1df61b800 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:39.041366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 117/232] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:38 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:39.047197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f939743-3679-41cb-9737-daa1df61b800 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:39.142787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc10e00-d63f-4fce-9b3a-1cb9a8e9d5ac None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:39.168709 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f939743-3679-41cb-9737-daa1df61b800 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:39.207069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac1e5a-7aa3-41fa-bcd6-cea33c9db600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:39.207752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac1e5a-7aa3-41fa-bcd6-cea33c9db600 None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:39.208039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac1e5a-7aa3-41fa-bcd6-cea33c9db600 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:39.208320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac1e5a-7aa3-41fa-bcd6-cea33c9db600 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/users/7bcd730eb0154e48ba9837a11cf6dbfa/roles/e1f4e92f38534e1d80123b0beaa2be47` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:39.211294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac1e5a-7aa3-41fa-bcd6-cea33c9db600 None admin] RBAC: Authorizing `identity:create_grant(project_id=2998613f90a9440da9bf8b1b9eedbb96, user_id=7bcd730eb0154e48ba9837a11cf6dbfa, role_id=e1f4e92f38534e1d80123b0beaa2be47)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:39.212779 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac1e5a-7aa3-41fa-bcd6-cea33c9db600 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:39.230061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 118/233] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:09:39 2022] PUT /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/users/7bcd730eb0154e48ba9837a11cf6dbfa/roles/e1f4e92f38534e1d80123b0beaa2be47 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:09:39.242062 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba09d7-e825-417b-9b82-02933527d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:39.242842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba09d7-e825-417b-9b82-02933527d604 None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:39.243124 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba09d7-e825-417b-9b82-02933527d604 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:39.243453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba09d7-e825-417b-9b82-02933527d604 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/users/7bcd730eb0154e48ba9837a11cf6dbfa/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:39.249787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba09d7-e825-417b-9b82-02933527d604 None admin] RBAC: Authorizing `identity:create_grant(project_id=2998613f90a9440da9bf8b1b9eedbb96, user_id=7bcd730eb0154e48ba9837a11cf6dbfa, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:39.251358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba09d7-e825-417b-9b82-02933527d604 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:39.279929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 116/234] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:09:38 2022] PUT /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/users/7bcd730eb0154e48ba9837a11cf6dbfa/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:09:40.136450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403db582-b278-47ad-85f1-a3655a3fb016 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:40.137003 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403db582-b278-47ad-85f1-a3655a3fb016 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:40.137003 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403db582-b278-47ad-85f1-a3655a3fb016 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:40.138913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 119/235] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:40.144525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433bd44-d5ed-4fd4-8e60-67bcb49b0c16 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:40.144976 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433bd44-d5ed-4fd4-8e60-67bcb49b0c16 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:40.145051 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433bd44-d5ed-4fd4-8e60-67bcb49b0c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:40.171047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-4433bd44-d5ed-4fd4-8e60-67bcb49b0c16 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:40.172870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4433bd44-d5ed-4fd4-8e60-67bcb49b0c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:40.253571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd30fb-8e3c-4059-8203-b61f37988ba3 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:40.253891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd30fb-8e3c-4059-8203-b61f37988ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:40.254152 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd30fb-8e3c-4059-8203-b61f37988ba3 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:40.255669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 120/236] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:09:40.270642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4351d51-c0fc-446a-991d-74aeaa960770 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:40.270947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4351d51-c0fc-446a-991d-74aeaa960770 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:40.271191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4351d51-c0fc-446a-991d-74aeaa960770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:40.272802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 117/237] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:40.298809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433bd44-d5ed-4fd4-8e60-67bcb49b0c16 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:40.311096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-b4351d51-c0fc-446a-991d-74aeaa960770 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:40.312309 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b4351d51-c0fc-446a-991d-74aeaa960770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:40.314112 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:40.348808 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:40.429095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433bd44-d5ed-4fd4-8e60-67bcb49b0c16 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:40.470464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770701f-6957-4dcf-8f93-b1aa3e2a0f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:40.471130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770701f-6957-4dcf-8f93-b1aa3e2a0f5d None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:40.471411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770701f-6957-4dcf-8f93-b1aa3e2a0f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:40.471849 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770701f-6957-4dcf-8f93-b1aa3e2a0f5d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:40.484046 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770701f-6957-4dcf-8f93-b1aa3e2a0f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:40.488031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 121/238] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-5770701f-6957-4dcf-8f93-b1aa3e2a0f5d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:40.489430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:40.490341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:40.491123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 118/239] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:40.496978 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4351d51-c0fc-446a-991d-74aeaa960770 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:40.532494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770701f-6957-4dcf-8f93-b1aa3e2a0f5d None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:40.624819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:40.664939 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770701f-6957-4dcf-8f93-b1aa3e2a0f5d None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:40.675414 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4351d51-c0fc-446a-991d-74aeaa960770 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:40.705027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7e26-fdf4-4466-b8d2-dbeffa40c249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:40.705688 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7e26-fdf4-4466-b8d2-dbeffa40c249 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:40.705969 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7e26-fdf4-4466-b8d2-dbeffa40c249 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:40.706279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e7e26-fdf4-4466-b8d2-dbeffa40c249 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:40.708032 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e7e26-fdf4-4466-b8d2-dbeffa40c249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:40.709511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e7e26-fdf4-4466-b8d2-dbeffa40c249 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:40.711432 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 119/240] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:40.717139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7e26-fdf4-4466-b8d2-dbeffa40c249 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:40.735373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39e4b-af88-4581-8861-749cb3c4469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:40.736089 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39e4b-af88-4581-8861-749cb3c4469f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:40.736369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39e4b-af88-4581-8861-749cb3c4469f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:40.736650 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39e4b-af88-4581-8861-749cb3c4469f None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:40.737396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c39e4b-af88-4581-8861-749cb3c4469f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:40.737700 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c39e4b-af88-4581-8861-749cb3c4469f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:40.742542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c39e4b-af88-4581-8861-749cb3c4469f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:40.762310 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 122/241] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:40.769321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39e4b-af88-4581-8861-749cb3c4469f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:40.806762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:40.927904 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e7e26-fdf4-4466-b8d2-dbeffa40c249 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:40.958866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39e4b-af88-4581-8861-749cb3c4469f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:40.979481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7515f05-e151-4d11-8f4f-4151a1fe8140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:40.980277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7515f05-e151-4d11-8f4f-4151a1fe8140 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:40.980685 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7515f05-e151-4d11-8f4f-4151a1fe8140 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:40.981065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7515f05-e151-4d11-8f4f-4151a1fe8140 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:40.982161 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7515f05-e151-4d11-8f4f-4151a1fe8140 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:40.983832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7515f05-e151-4d11-8f4f-4151a1fe8140 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:41.002832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:41.020160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 120/242] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:09:40 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:09:41.024847 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08411b08-d422-4175-8147-4096c7a77550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:41.025614 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411b08-d422-4175-8147-4096c7a77550 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:41.025971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411b08-d422-4175-8147-4096c7a77550 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:41.026389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08411b08-d422-4175-8147-4096c7a77550 None admin] PATH_INFO: `/v3/users/ac10df540a35458dbb5417ffabd22895` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:41.043793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08411b08-d422-4175-8147-4096c7a77550 None admin] RBAC: Authorizing `identity:get_user(user_id=ac10df540a35458dbb5417ffabd22895)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:41.045422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08411b08-d422-4175-8147-4096c7a77550 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:41.048108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 123/243] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:40 2022] GET /identity/v3/users/ac10df540a35458dbb5417ffabd22895 => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:41.054582 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7515f05-e151-4d11-8f4f-4151a1fe8140 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:41.213820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7515f05-e151-4d11-8f4f-4151a1fe8140 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:41.260915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faefd3-fa77-4f0f-9a93-e50988d8f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:41.261557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faefd3-fa77-4f0f-9a93-e50988d8f862 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:41.261862 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faefd3-fa77-4f0f-9a93-e50988d8f862 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:41.262176 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faefd3-fa77-4f0f-9a93-e50988d8f862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:41.335178 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:41.347145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faefd3-fa77-4f0f-9a93-e50988d8f862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:41.348367 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd6a4-bc34-4104-94cb-3701b72e1f99 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:41.349177 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd6a4-bc34-4104-94cb-3701b72e1f99 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:41.349652 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bd6a4-bc34-4104-94cb-3701b72e1f99 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:41.352066 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 124/244] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:09:41.356056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faefd3-fa77-4f0f-9a93-e50988d8f862 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:41.358417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd59b66-6b13-4264-8bfe-cb11507d2e2a None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:41.358965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd59b66-6b13-4264-8bfe-cb11507d2e2a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:41.359504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd59b66-6b13-4264-8bfe-cb11507d2e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:41.380547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-0cd59b66-6b13-4264-8bfe-cb11507d2e2a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:41.382205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-0cd59b66-6b13-4264-8bfe-cb11507d2e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:41.480036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 121/245] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:41.482348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 125/246] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:41.492639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faefd3-fa77-4f0f-9a93-e50988d8f862 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:41.523639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd59b66-6b13-4264-8bfe-cb11507d2e2a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:41.527651 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:41.634412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:41.643273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faefd3-fa77-4f0f-9a93-e50988d8f862 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:41.688517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949abf-e3f0-4246-9705-2dc08f77a621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:41.689288 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949abf-e3f0-4246-9705-2dc08f77a621 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:41.689632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949abf-e3f0-4246-9705-2dc08f77a621 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:41.689971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b949abf-e3f0-4246-9705-2dc08f77a621 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:41.690850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd59b66-6b13-4264-8bfe-cb11507d2e2a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:41.691348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b949abf-e3f0-4246-9705-2dc08f77a621 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:41.693802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b949abf-e3f0-4246-9705-2dc08f77a621 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:41.697843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 122/247] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:41 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:41.711009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949abf-e3f0-4246-9705-2dc08f77a621 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:41.737345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4478ae-45f2-46a0-9733-c0300fcaca77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:41.738815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4478ae-45f2-46a0-9733-c0300fcaca77 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:41.739527 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4478ae-45f2-46a0-9733-c0300fcaca77 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:41.739972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4478ae-45f2-46a0-9733-c0300fcaca77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:41.758594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4478ae-45f2-46a0-9733-c0300fcaca77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-ab4478ae-45f2-46a0-9733-c0300fcaca77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:41.765681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:41.767504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:41.768379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:41.770731 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 126/248] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:41.776840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4478ae-45f2-46a0-9733-c0300fcaca77 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:41.861807 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b949abf-e3f0-4246-9705-2dc08f77a621 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:41.874816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:41.939646 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e3331-c5e4-49a4-98ed-cec68410082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:41.940283 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3331-c5e4-49a4-98ed-cec68410082d None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:41.940561 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3331-c5e4-49a4-98ed-cec68410082d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:41.940832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3331-c5e4-49a4-98ed-cec68410082d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:41.941649 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e3331-c5e4-49a4-98ed-cec68410082d None admin] RBAC: Adding query filter params (role.id=39c9e7be022744fc9a349364ef6ce2d0, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96, user.id=ac10df540a35458dbb5417ffabd22895) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:41.941978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e3331-c5e4-49a4-98ed-cec68410082d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:41.946042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e3331-c5e4-49a4-98ed-cec68410082d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:41.957062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4478ae-45f2-46a0-9733-c0300fcaca77 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:41.960747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 123/249] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:41 2022] GET /identity/v3/role_assignments?user.id=ac10df540a35458dbb5417ffabd22895&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=39c9e7be022744fc9a349364ef6ce2d0 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:41.962152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d1fb-b149-4210-84c5-873d180d6567 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:41.962441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d1fb-b149-4210-84c5-873d180d6567 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:41.962716 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454d1fb-b149-4210-84c5-873d180d6567 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:41.964020 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 124/250] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:41.969798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0c044-e411-4aee-b555-18b871baefde None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:41.970166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0c044-e411-4aee-b555-18b871baefde None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:41.970385 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0c044-e411-4aee-b555-18b871baefde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:42.010215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-9de0c044-e411-4aee-b555-18b871baefde None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:42.011473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9de0c044-e411-4aee-b555-18b871baefde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:42.051690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b09e7-03e4-4e63-9e59-2c38c4950a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:42.052695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b09e7-03e4-4e63-9e59-2c38c4950a5b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:42.053180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b09e7-03e4-4e63-9e59-2c38c4950a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:42.053671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b09e7-03e4-4e63-9e59-2c38c4950a5b None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:42.054851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b09e7-03e4-4e63-9e59-2c38c4950a5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:42.055401 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b09e7-03e4-4e63-9e59-2c38c4950a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:42.057785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b09e7-03e4-4e63-9e59-2c38c4950a5b None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:42.071829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:42.079331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 127/251] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:42.084784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b09e7-03e4-4e63-9e59-2c38c4950a5b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:42.199598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 125/252] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:42.244442 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0c044-e411-4aee-b555-18b871baefde None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:42.330880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b09e7-03e4-4e63-9e59-2c38c4950a5b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:42.377865 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:42.396422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd8ed2-9fbe-4ffb-88ed-0218dc9abd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:42.397076 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd8ed2-9fbe-4ffb-88ed-0218dc9abd20 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:42.397354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd8ed2-9fbe-4ffb-88ed-0218dc9abd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:42.397629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd8ed2-9fbe-4ffb-88ed-0218dc9abd20 None admin] PATH_INFO: `/v3/users/aad91e24194548f3b699fed072d7bcf3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:42.398828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd8ed2-9fbe-4ffb-88ed-0218dc9abd20 None admin] RBAC: Authorizing `identity:get_user(user_id=aad91e24194548f3b699fed072d7bcf3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:42.400265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd8ed2-9fbe-4ffb-88ed-0218dc9abd20 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:42.401866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 128/253] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:42 2022] GET /identity/v3/users/aad91e24194548f3b699fed072d7bcf3 => generated 297 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:42.405024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7131ed-fcc7-44f2-b9b5-d02492c4daaa None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:42.405296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7131ed-fcc7-44f2-b9b5-d02492c4daaa None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:42.405569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7131ed-fcc7-44f2-b9b5-d02492c4daaa None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:42.408643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 129/254] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:42.414541 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7131ed-fcc7-44f2-b9b5-d02492c4daaa None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:42.454517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0c044-e411-4aee-b555-18b871baefde None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:42.506849 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0db9f6-4982-412a-9dac-d2d9ad0a7419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:42.507635 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0db9f6-4982-412a-9dac-d2d9ad0a7419 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:42.507969 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0db9f6-4982-412a-9dac-d2d9ad0a7419 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:42.508243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0db9f6-4982-412a-9dac-d2d9ad0a7419 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:42.528302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0db9f6-4982-412a-9dac-d2d9ad0a7419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-5e0db9f6-4982-412a-9dac-d2d9ad0a7419 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:42.536532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:42.537455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:42.538306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:42.542096 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 126/255] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:09:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:42.543528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a53ffe-de01-4668-9b61-acddc953657f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:42.543808 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a53ffe-de01-4668-9b61-acddc953657f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:42.544082 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a53ffe-de01-4668-9b61-acddc953657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:42.580116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-62a53ffe-de01-4668-9b61-acddc953657f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:42.581358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-62a53ffe-de01-4668-9b61-acddc953657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:42.610362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:42.610556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7131ed-fcc7-44f2-b9b5-d02492c4daaa None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:42.681601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810755f-b941-40fb-a87e-2877be5487d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:42.682271 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810755f-b941-40fb-a87e-2877be5487d0 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:42.682550 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810755f-b941-40fb-a87e-2877be5487d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:42.682881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810755f-b941-40fb-a87e-2877be5487d0 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:42.684096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810755f-b941-40fb-a87e-2877be5487d0 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:42.685523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810755f-b941-40fb-a87e-2877be5487d0 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:42.692034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 130/256] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:42 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:42.692848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810755f-b941-40fb-a87e-2877be5487d0 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:42.700072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 127/257] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:42.706161 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a53ffe-de01-4668-9b61-acddc953657f None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:42.777489 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:42.851102 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810755f-b941-40fb-a87e-2877be5487d0 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:42.892995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a53ffe-de01-4668-9b61-acddc953657f None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:42.912783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920479d1-a643-4e81-b601-bda736bfe479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:42.913426 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920479d1-a643-4e81-b601-bda736bfe479 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:42.913709 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920479d1-a643-4e81-b601-bda736bfe479 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:42.913992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920479d1-a643-4e81-b601-bda736bfe479 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:42.914746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920479d1-a643-4e81-b601-bda736bfe479 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:42.915057 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920479d1-a643-4e81-b601-bda736bfe479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:42.916681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920479d1-a643-4e81-b601-bda736bfe479 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:42.936135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 131/258] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:09:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:42.936985 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920479d1-a643-4e81-b601-bda736bfe479 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:42.962519 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810fccc-6cd8-4644-86f4-ea06b535c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:42.963203 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810fccc-6cd8-4644-86f4-ea06b535c72a None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:42.963491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810fccc-6cd8-4644-86f4-ea06b535c72a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:42.963773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810fccc-6cd8-4644-86f4-ea06b535c72a None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/users/aad91e24194548f3b699fed072d7bcf3/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:42.968075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810fccc-6cd8-4644-86f4-ea06b535c72a None admin] RBAC: Authorizing `identity:create_grant(project_id=2998613f90a9440da9bf8b1b9eedbb96, user_id=aad91e24194548f3b699fed072d7bcf3, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:42.969974 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810fccc-6cd8-4644-86f4-ea06b535c72a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:43.009159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 128/259] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:09:42 2022] PUT /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/users/aad91e24194548f3b699fed072d7bcf3/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:09:43.010420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810fccc-6cd8-4644-86f4-ea06b535c72a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:43.039977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:43.128219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920479d1-a643-4e81-b601-bda736bfe479 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:43.179264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:43.199159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beff3d-1025-46ec-b167-cb9e4df57106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:43.200609 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beff3d-1025-46ec-b167-cb9e4df57106 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:43.201175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beff3d-1025-46ec-b167-cb9e4df57106 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:43.201459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beff3d-1025-46ec-b167-cb9e4df57106 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:43.222142 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1beff3d-1025-46ec-b167-cb9e4df57106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:43.229019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810fccc-6cd8-4644-86f4-ea06b535c72a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-b1beff3d-1025-46ec-b167-cb9e4df57106 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:43.234756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:43.235688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:43.236565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:43.239033 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 132/260] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:09:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:43.245111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beff3d-1025-46ec-b167-cb9e4df57106 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:43.277789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360084-30e9-4020-96de-8bc8b31284a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:43.278593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360084-30e9-4020-96de-8bc8b31284a5 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:43.278884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360084-30e9-4020-96de-8bc8b31284a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:43.279165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360084-30e9-4020-96de-8bc8b31284a5 None admin] PATH_INFO: `/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:43.280662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0360084-30e9-4020-96de-8bc8b31284a5 None admin] RBAC: Authorizing `identity:get_user(user_id=7bcd730eb0154e48ba9837a11cf6dbfa)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:43.282840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0360084-30e9-4020-96de-8bc8b31284a5 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:43.289508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 129/261] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:43 2022] GET /identity/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:43.290583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360084-30e9-4020-96de-8bc8b31284a5 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:43.392295 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beff3d-1025-46ec-b167-cb9e4df57106 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:43.408670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:43.447164 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde49d5-3b77-4f3b-be34-ead3daac5503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:43.447793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde49d5-3b77-4f3b-be34-ead3daac5503 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:43.448077 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde49d5-3b77-4f3b-be34-ead3daac5503 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:43.448342 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde49d5-3b77-4f3b-be34-ead3daac5503 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:43.449067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde49d5-3b77-4f3b-be34-ead3daac5503 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:43.449371 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde49d5-3b77-4f3b-be34-ead3daac5503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:43.450817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde49d5-3b77-4f3b-be34-ead3daac5503 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:43.454479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360084-30e9-4020-96de-8bc8b31284a5 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:43.470531 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 133/262] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:43.476134 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde49d5-3b77-4f3b-be34-ead3daac5503 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:43.518232 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c79758-4bb0-476f-bcb8-a5f67b31200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:43.518856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79758-4bb0-476f-bcb8-a5f67b31200e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:43.519130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79758-4bb0-476f-bcb8-a5f67b31200e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:43.519399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79758-4bb0-476f-bcb8-a5f67b31200e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:43.556830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:43.647507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c79758-4bb0-476f-bcb8-a5f67b31200e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:43.648876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c79758-4bb0-476f-bcb8-a5f67b31200e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:43.655180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde49d5-3b77-4f3b-be34-ead3daac5503 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:43.720374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edad295-c156-4280-a56a-aea888568d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:43.721071 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edad295-c156-4280-a56a-aea888568d7d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:43.721345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edad295-c156-4280-a56a-aea888568d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:43.721620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edad295-c156-4280-a56a-aea888568d7d None admin] PATH_INFO: `/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:43.723136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edad295-c156-4280-a56a-aea888568d7d None admin] RBAC: Authorizing `identity:get_user(user_id=7bcd730eb0154e48ba9837a11cf6dbfa)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:43.724566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edad295-c156-4280-a56a-aea888568d7d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:43.726527 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 134/263] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:43 2022] GET /identity/v3/users/7bcd730eb0154e48ba9837a11cf6dbfa => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:43.734164 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edad295-c156-4280-a56a-aea888568d7d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:43.797869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:43.871071 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 130/264] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:43.879387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c79758-4bb0-476f-bcb8-a5f67b31200e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:43.953069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edad295-c156-4280-a56a-aea888568d7d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:43.991318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20f31e-5590-400b-8a0a-eab83b1b9f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:43.992323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20f31e-5590-400b-8a0a-eab83b1b9f7d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:43.992822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20f31e-5590-400b-8a0a-eab83b1b9f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:43.993308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20f31e-5590-400b-8a0a-eab83b1b9f7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.018423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:44.044012 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c79758-4bb0-476f-bcb8-a5f67b31200e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:44.071324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20f31e-5590-400b-8a0a-eab83b1b9f7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:44.073222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20f31e-5590-400b-8a0a-eab83b1b9f7d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:44.108059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748876e-dd7b-4d26-a3e2-e9f266364c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:44.108710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748876e-dd7b-4d26-a3e2-e9f266364c3c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.108989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748876e-dd7b-4d26-a3e2-e9f266364c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.109260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748876e-dd7b-4d26-a3e2-e9f266364c3c None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.114718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748876e-dd7b-4d26-a3e2-e9f266364c3c None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:44.116169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748876e-dd7b-4d26-a3e2-e9f266364c3c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:44.118472 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 131/265] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:43 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:44.123777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748876e-dd7b-4d26-a3e2-e9f266364c3c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:44.211605 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:44.218616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 135/266] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:09:44.224341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20f31e-5590-400b-8a0a-eab83b1b9f7d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:44.278397 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:44.293572 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748876e-dd7b-4d26-a3e2-e9f266364c3c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:44.329909 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb89d6-b6a6-4294-bc0b-c969c1cf1d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:44.330560 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb89d6-b6a6-4294-bc0b-c969c1cf1d30 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.330839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb89d6-b6a6-4294-bc0b-c969c1cf1d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.331109 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb89d6-b6a6-4294-bc0b-c969c1cf1d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.331933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb89d6-b6a6-4294-bc0b-c969c1cf1d30 None admin] RBAC: Adding query filter params (role.id=e1f4e92f38534e1d80123b0beaa2be47, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96, user.id=7bcd730eb0154e48ba9837a11cf6dbfa) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:44.332194 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb89d6-b6a6-4294-bc0b-c969c1cf1d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:44.333611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb89d6-b6a6-4294-bc0b-c969c1cf1d30 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:44.340228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 132/267] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:44 2022] GET /identity/v3/role_assignments?user.id=7bcd730eb0154e48ba9837a11cf6dbfa&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=e1f4e92f38534e1d80123b0beaa2be47 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:44.341505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379e07-0749-42a6-bd1e-3f0594754c03 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.342186 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379e07-0749-42a6-bd1e-3f0594754c03 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.342560 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379e07-0749-42a6-bd1e-3f0594754c03 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.344001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 133/268] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:44.350824 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3211-37ed-4f46-b449-52d49a1f624c None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.351340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3211-37ed-4f46-b449-52d49a1f624c None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.351687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3211-37ed-4f46-b449-52d49a1f624c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.391581 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-395b3211-37ed-4f46-b449-52d49a1f624c None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:44.392964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-395b3211-37ed-4f46-b449-52d49a1f624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:44.441632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20f31e-5590-400b-8a0a-eab83b1b9f7d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:44.508540 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 134/269] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:44.510094 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb84a4a-39b4-43bc-9688-ae3cdef3ba11 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.510386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb84a4a-39b4-43bc-9688-ae3cdef3ba11 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.510660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb84a4a-39b4-43bc-9688-ae3cdef3ba11 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.512036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 135/270] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:44.517924 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb96ef-d646-432c-9918-85dd3c851238 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.518203 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb96ef-d646-432c-9918-85dd3c851238 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.518484 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb96ef-d646-432c-9918-85dd3c851238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.532671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65d413-fdb7-4c78-9df4-1e4c37ebb342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:44.533337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65d413-fdb7-4c78-9df4-1e4c37ebb342 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.533617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65d413-fdb7-4c78-9df4-1e4c37ebb342 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.533895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65d413-fdb7-4c78-9df4-1e4c37ebb342 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.538879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65d413-fdb7-4c78-9df4-1e4c37ebb342 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:44.540572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65d413-fdb7-4c78-9df4-1e4c37ebb342 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:44.542639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 136/271] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:44 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:44.549095 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65d413-fdb7-4c78-9df4-1e4c37ebb342 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:44.549265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-eeeb96ef-d646-432c-9918-85dd3c851238 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:44.550470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-eeeb96ef-d646-432c-9918-85dd3c851238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:44.590411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:44.638171 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 136/272] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:44.639242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb96ef-d646-432c-9918-85dd3c851238 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:44.715114 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:44.735145 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65d413-fdb7-4c78-9df4-1e4c37ebb342 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:44.763547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb96ef-d646-432c-9918-85dd3c851238 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:44.774971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe0d19-af61-4b3e-abe1-2b48103dd445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:44.775593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe0d19-af61-4b3e-abe1-2b48103dd445 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.775888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe0d19-af61-4b3e-abe1-2b48103dd445 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.776160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe0d19-af61-4b3e-abe1-2b48103dd445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.776942 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe0d19-af61-4b3e-abe1-2b48103dd445 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96, user.id=7bcd730eb0154e48ba9837a11cf6dbfa) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:44.777247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe0d19-af61-4b3e-abe1-2b48103dd445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:44.778840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe0d19-af61-4b3e-abe1-2b48103dd445 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:44.786933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 137/273] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:44 2022] GET /identity/v3/role_assignments?user.id=7bcd730eb0154e48ba9837a11cf6dbfa&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:44.787855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe0d19-af61-4b3e-abe1-2b48103dd445 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:44.809281 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdcef6-d8dc-4ebd-8a8b-6c66e868215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:44.810184 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdcef6-d8dc-4ebd-8a8b-6c66e868215f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.810465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdcef6-d8dc-4ebd-8a8b-6c66e868215f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.811121 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdcef6-d8dc-4ebd-8a8b-6c66e868215f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.812425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdcef6-d8dc-4ebd-8a8b-6c66e868215f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:44.814518 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdcef6-d8dc-4ebd-8a8b-6c66e868215f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:44.816934 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 137/274] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:44.822713 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdcef6-d8dc-4ebd-8a8b-6c66e868215f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:44.861724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:44.907508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe0d19-af61-4b3e-abe1-2b48103dd445 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:44.935901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdcef6-d8dc-4ebd-8a8b-6c66e868215f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:44.955930 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82769cac-5c95-427c-8728-8a5407fb2387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:44.956662 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769cac-5c95-427c-8728-8a5407fb2387 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.956948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769cac-5c95-427c-8728-8a5407fb2387 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.957224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769cac-5c95-427c-8728-8a5407fb2387 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.974782 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac03ca6-389b-49d3-9120-ca72d9a95858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:44.975410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac03ca6-389b-49d3-9120-ca72d9a95858 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.975687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac03ca6-389b-49d3-9120-ca72d9a95858 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.975963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac03ca6-389b-49d3-9120-ca72d9a95858 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.976203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82769cac-5c95-427c-8728-8a5407fb2387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:44.977194 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac03ca6-389b-49d3-9120-ca72d9a95858 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:44.978694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac03ca6-389b-49d3-9120-ca72d9a95858 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-82769cac-5c95-427c-8728-8a5407fb2387 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:44.981961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:44.982900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:44.983785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:44.987669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 138/275] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:44.989747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e772ddb-bf74-44c7-9649-858a48ca5855 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:44.990588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e772ddb-bf74-44c7-9649-858a48ca5855 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:44.991072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e772ddb-bf74-44c7-9649-858a48ca5855 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:44.993846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 139/276] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:44.999500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e772ddb-bf74-44c7-9649-858a48ca5855 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:45.006606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 138/277] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:09:44 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:09:45.011528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f0f97-0e6e-463c-ae2b-7431e5cd06cb None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:45.011717 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:45.011795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f0f97-0e6e-463c-ae2b-7431e5cd06cb None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:45.012080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f0f97-0e6e-463c-ae2b-7431e5cd06cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:45.052501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-7f0f0f97-0e6e-463c-ae2b-7431e5cd06cb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:45.053642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7f0f0f97-0e6e-463c-ae2b-7431e5cd06cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:45.138818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 139/278] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:45.163956 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e772ddb-bf74-44c7-9649-858a48ca5855 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:45.175443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f0f97-0e6e-463c-ae2b-7431e5cd06cb None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:45.213000 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa463a-cba3-4a68-9aca-4b332fca5dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:45.213959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa463a-cba3-4a68-9aca-4b332fca5dee None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:45.214223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:45.214630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa463a-cba3-4a68-9aca-4b332fca5dee None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:45.215079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa463a-cba3-4a68-9aca-4b332fca5dee None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:45.215968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa463a-cba3-4a68-9aca-4b332fca5dee None admin] RBAC: Adding query filter params (name=member) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:45.216447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa463a-cba3-4a68-9aca-4b332fca5dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:45.218078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa463a-cba3-4a68-9aca-4b332fca5dee None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:45.228986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 140/279] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:45.234710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa463a-cba3-4a68-9aca-4b332fca5dee None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:45.318981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f0f97-0e6e-463c-ae2b-7431e5cd06cb None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:45.320584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:45.358041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe968e9-7b60-4935-bae6-0c1f521cf242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:45.358706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe968e9-7b60-4935-bae6-0c1f521cf242 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:45.358990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe968e9-7b60-4935-bae6-0c1f521cf242 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:45.359271 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe968e9-7b60-4935-bae6-0c1f521cf242 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:45.372082 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe968e9-7b60-4935-bae6-0c1f521cf242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:45.377974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa463a-cba3-4a68-9aca-4b332fca5dee None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-1fe968e9-7b60-4935-bae6-0c1f521cf242 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:45.378908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:45.379816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:45.380628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 140/280] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:45.385846 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe968e9-7b60-4935-bae6-0c1f521cf242 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:45.426840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c18409-7eee-4150-82df-81a3a49aa7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:45.427893 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c18409-7eee-4150-82df-81a3a49aa7cd None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:45.428376 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c18409-7eee-4150-82df-81a3a49aa7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:45.428931 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c18409-7eee-4150-82df-81a3a49aa7cd None admin] PATH_INFO: `/v3/users/0a71ec6ff5aa4593856e510017c60fca` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:45.447486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c18409-7eee-4150-82df-81a3a49aa7cd None admin] RBAC: Authorizing `identity:get_user(user_id=0a71ec6ff5aa4593856e510017c60fca)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:45.448961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c18409-7eee-4150-82df-81a3a49aa7cd None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:45.450710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 141/281] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:45 2022] GET /identity/v3/users/0a71ec6ff5aa4593856e510017c60fca => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:45.457689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c18409-7eee-4150-82df-81a3a49aa7cd None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:45.492726 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:45.513291 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe968e9-7b60-4935-bae6-0c1f521cf242 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:45.552221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e057-78cb-47ec-b16e-5cdcba6844c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:45.553223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e057-78cb-47ec-b16e-5cdcba6844c7 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:45.553704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e057-78cb-47ec-b16e-5cdcba6844c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:45.554295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e057-78cb-47ec-b16e-5cdcba6844c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:45.555416 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58e057-78cb-47ec-b16e-5cdcba6844c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:45.555973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58e057-78cb-47ec-b16e-5cdcba6844c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:45.557564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58e057-78cb-47ec-b16e-5cdcba6844c7 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:45.567232 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 141/282] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:45.574117 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e057-78cb-47ec-b16e-5cdcba6844c7 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:45.581174 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c18409-7eee-4150-82df-81a3a49aa7cd None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:45.629564 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:45.647459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de092034-b64b-45ae-a37b-e97790a4cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:45.648406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de092034-b64b-45ae-a37b-e97790a4cae5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:45.648859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de092034-b64b-45ae-a37b-e97790a4cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:45.649334 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de092034-b64b-45ae-a37b-e97790a4cae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:45.650642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de092034-b64b-45ae-a37b-e97790a4cae5 None admin] RBAC: Adding query filter params (role.id=a4aae8b3b8b4486389006b0d25566eb6, user.id=0a71ec6ff5aa4593856e510017c60fca, scope.system=all) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:45.652115 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de092034-b64b-45ae-a37b-e97790a4cae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:45.653736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de092034-b64b-45ae-a37b-e97790a4cae5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:45.664308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 142/283] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 2 08:09:45 2022] GET /identity/v3/role_assignments?user.id=0a71ec6ff5aa4593856e510017c60fca&scope.system=all&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:45.716366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e057-78cb-47ec-b16e-5cdcba6844c7 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:45.752295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ddaa3-f1c6-42ae-bc92-6e75c541bce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:45.753247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ddaa3-f1c6-42ae-bc92-6e75c541bce8 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:45.753699 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ddaa3-f1c6-42ae-bc92-6e75c541bce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:45.754170 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ddaa3-f1c6-42ae-bc92-6e75c541bce8 None admin] PATH_INFO: `/v3/users/ac10df540a35458dbb5417ffabd22895` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:45.755536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ddaa3-f1c6-42ae-bc92-6e75c541bce8 None admin] RBAC: Authorizing `identity:get_user(user_id=ac10df540a35458dbb5417ffabd22895)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:45.757262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ddaa3-f1c6-42ae-bc92-6e75c541bce8 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:45.759457 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 142/284] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:45 2022] GET /identity/v3/users/ac10df540a35458dbb5417ffabd22895 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:45.767506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de092034-b64b-45ae-a37b-e97790a4cae5 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:45.893849 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de092034-b64b-45ae-a37b-e97790a4cae5 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:45.932235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7062047-852f-4134-a687-4e99349d95f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:45.933202 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7062047-852f-4134-a687-4e99349d95f9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:45.933655 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7062047-852f-4134-a687-4e99349d95f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:45.934132 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7062047-852f-4134-a687-4e99349d95f9 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:45.935524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7062047-852f-4134-a687-4e99349d95f9 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:45.937153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7062047-852f-4134-a687-4e99349d95f9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:45.939744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 143/285] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:45 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:45.945401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ddaa3-f1c6-42ae-bc92-6e75c541bce8 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:45.971447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:46.080205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ddaa3-f1c6-42ae-bc92-6e75c541bce8 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:46.114406 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7d9fa-c3bf-4a79-9a33-4bfff8a5d24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:46.115144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7d9fa-c3bf-4a79-9a33-4bfff8a5d24a None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:46.115421 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7d9fa-c3bf-4a79-9a33-4bfff8a5d24a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:46.115696 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7d9fa-c3bf-4a79-9a33-4bfff8a5d24a None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/users/ac10df540a35458dbb5417ffabd22895/roles/39c9e7be022744fc9a349364ef6ce2d0` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:46.117688 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7d9fa-c3bf-4a79-9a33-4bfff8a5d24a None admin] RBAC: Authorizing `identity:create_grant(project_id=2998613f90a9440da9bf8b1b9eedbb96, user_id=ac10df540a35458dbb5417ffabd22895, role_id=39c9e7be022744fc9a349364ef6ce2d0)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:46.119156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7d9fa-c3bf-4a79-9a33-4bfff8a5d24a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:46.136523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 143/286] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:09:45 2022] PUT /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/users/ac10df540a35458dbb5417ffabd22895/roles/39c9e7be022744fc9a349364ef6ce2d0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:09:46.185230 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c3ed4-51e1-455f-a912-18b4de7800ad None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:46.185542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c3ed4-51e1-455f-a912-18b4de7800ad None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:46.185790 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c3ed4-51e1-455f-a912-18b4de7800ad None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:46.187587 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 144/287] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:46.194225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3a34-e6b7-4ccf-a78a-9125c971afe7 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:46.194605 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3a34-e6b7-4ccf-a78a-9125c971afe7 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:46.194958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c3a34-e6b7-4ccf-a78a-9125c971afe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:46.220924 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-bf2c3a34-e6b7-4ccf-a78a-9125c971afe7 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:46.222280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-bf2c3a34-e6b7-4ccf-a78a-9125c971afe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:46.323468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 144/288] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:46.357296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c3ed4-51e1-455f-a912-18b4de7800ad None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:46.430246 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:46.482630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c3ed4-51e1-455f-a912-18b4de7800ad None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:46.526671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5e4ce-b6ef-4851-a320-c648641a46b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:46.527325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e4ce-b6ef-4851-a320-c648641a46b1 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:46.527607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e4ce-b6ef-4851-a320-c648641a46b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:46.527881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5e4ce-b6ef-4851-a320-c648641a46b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:46.543511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5e4ce-b6ef-4851-a320-c648641a46b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-a1c5e4ce-b6ef-4851-a320-c648641a46b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:46.549059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:46.549918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:46.550754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:46.554308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 145/289] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:46.560266 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3a34-e6b7-4ccf-a78a-9125c971afe7 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:46.562474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:46.698232 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c3a34-e6b7-4ccf-a78a-9125c971afe7 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:46.746548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8d203-4bb5-453b-af92-6c11512971e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:46.747091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8d203-4bb5-453b-af92-6c11512971e3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:46.747372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8d203-4bb5-453b-af92-6c11512971e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:46.747645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8d203-4bb5-453b-af92-6c11512971e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:46.748364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8d203-4bb5-453b-af92-6c11512971e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:46.748678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8d203-4bb5-453b-af92-6c11512971e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:46.750068 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8d203-4bb5-453b-af92-6c11512971e3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:46.764255 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 145/290] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:46.770092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5e4ce-b6ef-4851-a320-c648641a46b1 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:46.888412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5e4ce-b6ef-4851-a320-c648641a46b1 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:46.906119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:46.932055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09630-423a-4355-9331-150b9641ba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:46.932712 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09630-423a-4355-9331-150b9641ba69 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:46.932994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09630-423a-4355-9331-150b9641ba69 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:46.933274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09630-423a-4355-9331-150b9641ba69 None admin] PATH_INFO: `/v3/users/aad91e24194548f3b699fed072d7bcf3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:46.938645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b09630-423a-4355-9331-150b9641ba69 None admin] RBAC: Authorizing `identity:get_user(user_id=aad91e24194548f3b699fed072d7bcf3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:46.940098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b09630-423a-4355-9331-150b9641ba69 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:46.941711 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 146/291] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:46 2022] GET /identity/v3/users/aad91e24194548f3b699fed072d7bcf3 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:46.947702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8d203-4bb5-453b-af92-6c11512971e3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:47.032767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:47.084798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8d203-4bb5-453b-af92-6c11512971e3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:47.124037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6050e8-f52c-4812-8a1b-ba97e313acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:47.124669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6050e8-f52c-4812-8a1b-ba97e313acf9 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:47.124952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6050e8-f52c-4812-8a1b-ba97e313acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:47.125265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6050e8-f52c-4812-8a1b-ba97e313acf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:47.221516 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6050e8-f52c-4812-8a1b-ba97e313acf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:47.223020 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6050e8-f52c-4812-8a1b-ba97e313acf9 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:47.307882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:47.360098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 146/292] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:09:47.366321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09630-423a-4355-9331-150b9641ba69 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:47.495747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09630-423a-4355-9331-150b9641ba69 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:47.531011 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf1e59-623e-4f88-9501-0b10b57be6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:47.531764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf1e59-623e-4f88-9501-0b10b57be6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:47.532047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf1e59-623e-4f88-9501-0b10b57be6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:47.532321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf1e59-623e-4f88-9501-0b10b57be6c4 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:47.533492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf1e59-623e-4f88-9501-0b10b57be6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:47.534966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf1e59-623e-4f88-9501-0b10b57be6c4 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:47.536936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 147/293] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:47 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:47.544892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6050e8-f52c-4812-8a1b-ba97e313acf9 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:47.658993 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9e810-76d2-42d6-afce-e176a25bb1e3 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:47.659178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9e810-76d2-42d6-afce-e176a25bb1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:47.659459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9e810-76d2-42d6-afce-e176a25bb1e3 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:47.660809 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 148/294] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:47.666631 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1896-b6b6-4978-8561-0e35a0201349 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:47.666943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1896-b6b6-4978-8561-0e35a0201349 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:47.667190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1896-b6b6-4978-8561-0e35a0201349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:47.690938 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-f78e1896-b6b6-4978-8561-0e35a0201349 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:47.692133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f78e1896-b6b6-4978-8561-0e35a0201349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:47.699290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6050e8-f52c-4812-8a1b-ba97e313acf9 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:47.777826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f1580-1b33-4027-9119-65fa1be423a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:47.778481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f1580-1b33-4027-9119-65fa1be423a1 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:47.778758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f1580-1b33-4027-9119-65fa1be423a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:47.779027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f1580-1b33-4027-9119-65fa1be423a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:47.779826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f1580-1b33-4027-9119-65fa1be423a1 None admin] RBAC: Adding query filter params (role.id=a4aae8b3b8b4486389006b0d25566eb6, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96, user.id=aad91e24194548f3b699fed072d7bcf3) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:47.780128 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f1580-1b33-4027-9119-65fa1be423a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:47.782641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f1580-1b33-4027-9119-65fa1be423a1 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:47.798226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 147/295] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:47 2022] GET /identity/v3/role_assignments?user.id=aad91e24194548f3b699fed072d7bcf3&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:47.814662 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:47.832820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 149/296] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:47.858911 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b59015-bc3c-4997-a9a7-1d1deed5e391 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:47.859240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b59015-bc3c-4997-a9a7-1d1deed5e391 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:47.859457 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b59015-bc3c-4997-a9a7-1d1deed5e391 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:47.861406 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 148/297] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:47.866882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462922f4-65bb-41ee-abd5-47e57acc342c None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:47.867166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462922f4-65bb-41ee-abd5-47e57acc342c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:47.867444 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462922f4-65bb-41ee-abd5-47e57acc342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:47.875961 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b59015-bc3c-4997-a9a7-1d1deed5e391 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:47.891568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-462922f4-65bb-41ee-abd5-47e57acc342c None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:47.893268 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-462922f4-65bb-41ee-abd5-47e57acc342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:47.937323 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:47.978404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 150/298] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:48.008026 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462922f4-65bb-41ee-abd5-47e57acc342c None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:48.059533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b59015-bc3c-4997-a9a7-1d1deed5e391 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:48.102430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34385952-23f2-4e5e-a76f-7524600cc6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:48.103094 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34385952-23f2-4e5e-a76f-7524600cc6ae None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:48.103534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34385952-23f2-4e5e-a76f-7524600cc6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:48.103938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34385952-23f2-4e5e-a76f-7524600cc6ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:48.105152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34385952-23f2-4e5e-a76f-7524600cc6ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:48.107634 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34385952-23f2-4e5e-a76f-7524600cc6ae None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:48.110063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 149/299] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:48.116092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34385952-23f2-4e5e-a76f-7524600cc6ae None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:48.145630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462922f4-65bb-41ee-abd5-47e57acc342c None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:48.167229 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:48.191437 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5292948-73c3-451e-8406-7a17971c9510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:48.192009 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5292948-73c3-451e-8406-7a17971c9510 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:48.192290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5292948-73c3-451e-8406-7a17971c9510 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:48.192566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5292948-73c3-451e-8406-7a17971c9510 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:48.205373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5292948-73c3-451e-8406-7a17971c9510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-e5292948-73c3-451e-8406-7a17971c9510 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:48.212611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:48.214399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:48.215812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 151/300] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:48.220919 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5292948-73c3-451e-8406-7a17971c9510 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:48.257460 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:48.266561 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34385952-23f2-4e5e-a76f-7524600cc6ae None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:48.317515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36313d7e-0ebd-4c74-9ac5-94c8af4ecfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:48.319586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313d7e-0ebd-4c74-9ac5-94c8af4ecfea None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:48.320657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313d7e-0ebd-4c74-9ac5-94c8af4ecfea None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:48.321139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36313d7e-0ebd-4c74-9ac5-94c8af4ecfea None admin] PATH_INFO: `/v3/groups` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:48.321978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36313d7e-0ebd-4c74-9ac5-94c8af4ecfea None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:48.323606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36313d7e-0ebd-4c74-9ac5-94c8af4ecfea None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:48.354283 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 150/301] 10.222.0.57 () {60 vars in 1134 bytes} [Tue Aug 2 08:09:48 2022] POST /identity/v3/groups => generated 229 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:09:48.366095 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5292948-73c3-451e-8406-7a17971c9510 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:48.408918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fceecc-0649-4dd4-96da-49c78e9c8029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:48.409566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fceecc-0649-4dd4-96da-49c78e9c8029 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:48.409989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fceecc-0649-4dd4-96da-49c78e9c8029 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:48.410289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fceecc-0649-4dd4-96da-49c78e9c8029 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:48.411036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fceecc-0649-4dd4-96da-49c78e9c8029 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:48.411343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fceecc-0649-4dd4-96da-49c78e9c8029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:48.412764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fceecc-0649-4dd4-96da-49c78e9c8029 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:48.424580 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 152/302] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:48.430489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36313d7e-0ebd-4c74-9ac5-94c8af4ecfea None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:48.483725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1571-84a9-489d-8229-e0d407027520 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:48.483910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1571-84a9-489d-8229-e0d407027520 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:48.484190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d1571-84a9-489d-8229-e0d407027520 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:48.486170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 153/303] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:09:48.491816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961677bd-3195-464d-9319-53b39a975de4 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:48.492099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961677bd-3195-464d-9319-53b39a975de4 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:48.492383 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961677bd-3195-464d-9319-53b39a975de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:48.511474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-961677bd-3195-464d-9319-53b39a975de4 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:48.512712 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-961677bd-3195-464d-9319-53b39a975de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:48.556894 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:48.560448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36313d7e-0ebd-4c74-9ac5-94c8af4ecfea None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:48.604428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc793a-a141-4bfa-b7ae-b025fdd89dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:48.605090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc793a-a141-4bfa-b7ae-b025fdd89dee None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:48.605376 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc793a-a141-4bfa-b7ae-b025fdd89dee None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:48.605653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc793a-a141-4bfa-b7ae-b025fdd89dee None admin] PATH_INFO: `/v3/users/1f77e22423c5497eb747f35fab773d8f` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:48.608749 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 154/304] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:48.620381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc793a-a141-4bfa-b7ae-b025fdd89dee None admin] RBAC: Authorizing `identity:get_user(user_id=1f77e22423c5497eb747f35fab773d8f)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:48.622119 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc793a-a141-4bfa-b7ae-b025fdd89dee None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:48.628846 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 151/305] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:48 2022] GET /identity/v3/users/1f77e22423c5497eb747f35fab773d8f => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:48.630539 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961677bd-3195-464d-9319-53b39a975de4 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:48.631291 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc793a-a141-4bfa-b7ae-b025fdd89dee None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:48.654214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:48.759685 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc793a-a141-4bfa-b7ae-b025fdd89dee None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:48.763347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961677bd-3195-464d-9319-53b39a975de4 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:48.799165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a625e4-9732-4739-89c9-78695e1be632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:48.800415 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a625e4-9732-4739-89c9-78695e1be632 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:48.800991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a625e4-9732-4739-89c9-78695e1be632 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:48.801484 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a625e4-9732-4739-89c9-78695e1be632 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:48.803527 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97ca3d-70d0-41d3-ac52-486c57ca5105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:48.804244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ca3d-70d0-41d3-ac52-486c57ca5105 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:48.804535 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ca3d-70d0-41d3-ac52-486c57ca5105 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:48.804815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97ca3d-70d0-41d3-ac52-486c57ca5105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:48.805611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97ca3d-70d0-41d3-ac52-486c57ca5105 None admin] RBAC: Adding query filter params (role.id=39c9e7be022744fc9a349364ef6ce2d0, user.id=1f77e22423c5497eb747f35fab773d8f, scope.system=all) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:48.805926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97ca3d-70d0-41d3-ac52-486c57ca5105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:48.807408 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97ca3d-70d0-41d3-ac52-486c57ca5105 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:48.812596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 155/306] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 2 08:09:48 2022] GET /identity/v3/role_assignments?user.id=1f77e22423c5497eb747f35fab773d8f&scope.system=all&role.id=39c9e7be022744fc9a349364ef6ce2d0 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:48.815159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a625e4-9732-4739-89c9-78695e1be632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:48.819135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3956-0d0f-479f-ba0b-d5af0dfd0d91 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:48.819560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3956-0d0f-479f-ba0b-d5af0dfd0d91 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:48.819800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3956-0d0f-479f-ba0b-d5af0dfd0d91 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:48.825505 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 156/307] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-e6a625e4-9732-4739-89c9-78695e1be632 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:48.825707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:48.827802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:48.829149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:48.831698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68127e4a-aae1-43d5-b8df-14c2a156f843 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:48.831987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68127e4a-aae1-43d5-b8df-14c2a156f843 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:48.832266 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68127e4a-aae1-43d5-b8df-14c2a156f843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:48.834448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 152/308] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:48.839623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a625e4-9732-4739-89c9-78695e1be632 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:48.854791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-68127e4a-aae1-43d5-b8df-14c2a156f843 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:48.856537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-68127e4a-aae1-43d5-b8df-14c2a156f843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:48.894680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:48.949232 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:48.960260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 157/309] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:48.983146 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68127e4a-aae1-43d5-b8df-14c2a156f843 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:48.986538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a625e4-9732-4739-89c9-78695e1be632 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:49.027464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407314c6-3ac8-4f86-b837-efc0ccdbec5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:49.028425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407314c6-3ac8-4f86-b837-efc0ccdbec5a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:49.028910 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407314c6-3ac8-4f86-b837-efc0ccdbec5a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:49.029456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407314c6-3ac8-4f86-b837-efc0ccdbec5a None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:49.030395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407314c6-3ac8-4f86-b837-efc0ccdbec5a None admin] RBAC: Adding query filter params (name=member) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:49.030897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407314c6-3ac8-4f86-b837-efc0ccdbec5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:49.032746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407314c6-3ac8-4f86-b837-efc0ccdbec5a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:49.042597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 153/310] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:49.048024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407314c6-3ac8-4f86-b837-efc0ccdbec5a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:49.104927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68127e4a-aae1-43d5-b8df-14c2a156f843 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:49.143754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569014-f6cb-4d7a-841f-2a35cddf17b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:49.144695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569014-f6cb-4d7a-841f-2a35cddf17b0 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:49.145170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569014-f6cb-4d7a-841f-2a35cddf17b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:49.145711 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569014-f6cb-4d7a-841f-2a35cddf17b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:49.157789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee569014-f6cb-4d7a-841f-2a35cddf17b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-ee569014-f6cb-4d7a-841f-2a35cddf17b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:49.163465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:49.164388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:49.165183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 158/311] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:49.172784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569014-f6cb-4d7a-841f-2a35cddf17b0 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:49.178903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407314c6-3ac8-4f86-b837-efc0ccdbec5a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:49.200908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:49.236004 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685323e-65b1-42ce-8dad-b086737bd42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:49.237553 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685323e-65b1-42ce-8dad-b086737bd42a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:49.238079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685323e-65b1-42ce-8dad-b086737bd42a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:49.238794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685323e-65b1-42ce-8dad-b086737bd42a None admin] PATH_INFO: `/v3/users/0a71ec6ff5aa4593856e510017c60fca` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:49.240844 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685323e-65b1-42ce-8dad-b086737bd42a None admin] RBAC: Authorizing `identity:get_user(user_id=0a71ec6ff5aa4593856e510017c60fca)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:49.243037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685323e-65b1-42ce-8dad-b086737bd42a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:49.246198 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 154/312] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:49 2022] GET /identity/v3/users/0a71ec6ff5aa4593856e510017c60fca => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:49.251676 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685323e-65b1-42ce-8dad-b086737bd42a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:49.256058 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:49.302762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569014-f6cb-4d7a-841f-2a35cddf17b0 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:49.349346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34029d5-ca3b-4069-b571-61a535a44ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:49.350507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34029d5-ca3b-4069-b571-61a535a44ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:49.350995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34029d5-ca3b-4069-b571-61a535a44ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:49.351636 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34029d5-ca3b-4069-b571-61a535a44ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:49.352564 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34029d5-ca3b-4069-b571-61a535a44ef5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:49.353009 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34029d5-ca3b-4069-b571-61a535a44ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:49.354878 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34029d5-ca3b-4069-b571-61a535a44ef5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:49.367002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685323e-65b1-42ce-8dad-b086737bd42a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:49.370157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 159/313] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:49.373958 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34029d5-ca3b-4069-b571-61a535a44ef5 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:49.407673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319fb63-920b-426a-b98a-595de0c6fbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:49.408749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319fb63-920b-426a-b98a-595de0c6fbe3 None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:49.409223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319fb63-920b-426a-b98a-595de0c6fbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:49.409689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319fb63-920b-426a-b98a-595de0c6fbe3 None admin] PATH_INFO: `/v3/system/users/0a71ec6ff5aa4593856e510017c60fca/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:49.411453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319fb63-920b-426a-b98a-595de0c6fbe3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0a71ec6ff5aa4593856e510017c60fca, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:49.413057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319fb63-920b-426a-b98a-595de0c6fbe3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:49.432310 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 155/314] 10.222.0.57 () {58 vars in 1334 bytes} [Tue Aug 2 08:09:49 2022] PUT /identity/v3/system/users/0a71ec6ff5aa4593856e510017c60fca/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:09:49.495623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:49.516566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34029d5-ca3b-4069-b571-61a535a44ef5 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:49.565770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18e909-e549-44b7-9415-d4b6c73110f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:49.566804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e909-e549-44b7-9415-d4b6c73110f3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:49.567313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e909-e549-44b7-9415-d4b6c73110f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:49.567792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d18e909-e549-44b7-9415-d4b6c73110f3 None admin] PATH_INFO: `/v3/users/ac10df540a35458dbb5417ffabd22895` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:49.569411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18e909-e549-44b7-9415-d4b6c73110f3 None admin] RBAC: Authorizing `identity:get_user(user_id=ac10df540a35458dbb5417ffabd22895)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:49.571404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d18e909-e549-44b7-9415-d4b6c73110f3 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:49.573719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 160/315] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:49 2022] GET /identity/v3/users/ac10df540a35458dbb5417ffabd22895 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:49.582518 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319fb63-920b-426a-b98a-595de0c6fbe3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:49.656870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:49.694130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319fb63-920b-426a-b98a-595de0c6fbe3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:49.728588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9299f3-cae7-4b76-bac5-ce69cbb52e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:49.729219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9299f3-cae7-4b76-bac5-ce69cbb52e10 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:49.729500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9299f3-cae7-4b76-bac5-ce69cbb52e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:49.729776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9299f3-cae7-4b76-bac5-ce69cbb52e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:49.800200 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9299f3-cae7-4b76-bac5-ce69cbb52e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:49.801667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9299f3-cae7-4b76-bac5-ce69cbb52e10 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:49.868076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:49.903500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 156/316] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:49.909502 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18e909-e549-44b7-9415-d4b6c73110f3 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:50.017370 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d18e909-e549-44b7-9415-d4b6c73110f3 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:50.053646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc77e2-ae22-4a08-85b2-93c48ec8d4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:50.054328 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc77e2-ae22-4a08-85b2-93c48ec8d4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:50.054613 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc77e2-ae22-4a08-85b2-93c48ec8d4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:50.054891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc77e2-ae22-4a08-85b2-93c48ec8d4a6 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:50.056053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc77e2-ae22-4a08-85b2-93c48ec8d4a6 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:50.057493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc77e2-ae22-4a08-85b2-93c48ec8d4a6 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:50.059182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 161/317] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:49 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:50.065098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9299f3-cae7-4b76-bac5-ce69cbb52e10 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:50.168317 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9299f3-cae7-4b76-bac5-ce69cbb52e10 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:50.204331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af0f0e-0d16-4d8a-9b02-30af95fbe349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:50.204957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0f0e-0d16-4d8a-9b02-30af95fbe349 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:50.205235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0f0e-0d16-4d8a-9b02-30af95fbe349 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:50.205509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0f0e-0d16-4d8a-9b02-30af95fbe349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:50.206331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af0f0e-0d16-4d8a-9b02-30af95fbe349 None admin] RBAC: Adding query filter params (role.id=39c9e7be022744fc9a349364ef6ce2d0, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96, user.id=ac10df540a35458dbb5417ffabd22895) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:50.206642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af0f0e-0d16-4d8a-9b02-30af95fbe349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:50.208075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af0f0e-0d16-4d8a-9b02-30af95fbe349 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:50.214280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 157/318] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:09:50 2022] GET /identity/v3/role_assignments?user.id=ac10df540a35458dbb5417ffabd22895&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=39c9e7be022744fc9a349364ef6ce2d0 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:50.512065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27e51-d6c8-4ae5-8c54-a34cd0bfe4c9 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:50.512441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27e51-d6c8-4ae5-8c54-a34cd0bfe4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:50.512617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27e51-d6c8-4ae5-8c54-a34cd0bfe4c9 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:50.514146 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 162/319] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:50.520291 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504405-801c-4823-b070-95f64796ad0f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:50.520825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504405-801c-4823-b070-95f64796ad0f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:50.521076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65504405-801c-4823-b070-95f64796ad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:50.540586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-65504405-801c-4823-b070-95f64796ad0f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:50.542058 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-65504405-801c-4823-b070-95f64796ad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:50.569499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:50.615821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 158/320] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:50.638991 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf27e51-d6c8-4ae5-8c54-a34cd0bfe4c9 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:50.661062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:50.747246 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf27e51-d6c8-4ae5-8c54-a34cd0bfe4c9 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:50.781070 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac93c50-89dd-4abe-9912-9c5f22873890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:50.782347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93c50-89dd-4abe-9912-9c5f22873890 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:50.782733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93c50-89dd-4abe-9912-9c5f22873890 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:50.783103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93c50-89dd-4abe-9912-9c5f22873890 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:50.784663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac93c50-89dd-4abe-9912-9c5f22873890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:50.786210 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac93c50-89dd-4abe-9912-9c5f22873890 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:50.787959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 163/321] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:09:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:50.793861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65504405-801c-4823-b070-95f64796ad0f None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:50.894627 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65504405-801c-4823-b070-95f64796ad0f None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:50.903948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b561c-a938-4cba-a8b1-927f7f0e03d3 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:50.904245 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b561c-a938-4cba-a8b1-927f7f0e03d3 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:50.904515 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b561c-a938-4cba-a8b1-927f7f0e03d3 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:50.906037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 164/322] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:09:50.911418 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b877688-9696-4ae9-8ed6-b4e514696d1b None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:50.911706 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b877688-9696-4ae9-8ed6-b4e514696d1b None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:50.911985 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b877688-9696-4ae9-8ed6-b4e514696d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:50.930514 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-2b877688-9696-4ae9-8ed6-b4e514696d1b None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:50.930936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1d605-c56f-4c53-a507-b354b91b9661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:50.931609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1d605-c56f-4c53-a507-b354b91b9661 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:50.931714 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-2b877688-9696-4ae9-8ed6-b4e514696d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:50.931892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1d605-c56f-4c53-a507-b354b91b9661 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:50.932163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1d605-c56f-4c53-a507-b354b91b9661 None admin] PATH_INFO: `/v3/groups` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:50.932838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1d605-c56f-4c53-a507-b354b91b9661 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:50.934301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1d605-c56f-4c53-a507-b354b91b9661 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:50.952167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 159/323] 10.222.0.57 () {60 vars in 1134 bytes} [Tue Aug 2 08:09:50 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:09:51.018322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 165/324] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:51.040803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1d605-c56f-4c53-a507-b354b91b9661 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:51.067790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:51.152520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1d605-c56f-4c53-a507-b354b91b9661 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:51.188446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173bae3-0a13-4482-88ef-be9d65c3eebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:51.189099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173bae3-0a13-4482-88ef-be9d65c3eebd None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:51.189380 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173bae3-0a13-4482-88ef-be9d65c3eebd None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:51.189651 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173bae3-0a13-4482-88ef-be9d65c3eebd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:51.200858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173bae3-0a13-4482-88ef-be9d65c3eebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-0173bae3-0a13-4482-88ef-be9d65c3eebd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:51.206991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:51.207878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:51.208678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 160/325] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:51.214404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b877688-9696-4ae9-8ed6-b4e514696d1b None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:51.236224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:51.326916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b877688-9696-4ae9-8ed6-b4e514696d1b None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:51.368951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818df4cb-5a11-4a78-889f-3d23f3e52752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:51.369592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818df4cb-5a11-4a78-889f-3d23f3e52752 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:51.369873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818df4cb-5a11-4a78-889f-3d23f3e52752 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:51.370176 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818df4cb-5a11-4a78-889f-3d23f3e52752 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:51.370906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818df4cb-5a11-4a78-889f-3d23f3e52752 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:51.371211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818df4cb-5a11-4a78-889f-3d23f3e52752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:51.372576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818df4cb-5a11-4a78-889f-3d23f3e52752 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:51.381697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 166/326] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:51.387174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173bae3-0a13-4482-88ef-be9d65c3eebd None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:51.496970 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:51.517184 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173bae3-0a13-4482-88ef-be9d65c3eebd None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:51.559717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5379ce-1b7d-4078-83df-2a8d4c674195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:51.560460 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5379ce-1b7d-4078-83df-2a8d4c674195 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:51.560643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5379ce-1b7d-4078-83df-2a8d4c674195 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:51.560911 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5379ce-1b7d-4078-83df-2a8d4c674195 None admin] PATH_INFO: `/v3/users/1f77e22423c5497eb747f35fab773d8f` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:51.562126 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5379ce-1b7d-4078-83df-2a8d4c674195 None admin] RBAC: Authorizing `identity:get_user(user_id=1f77e22423c5497eb747f35fab773d8f)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:51.563816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5379ce-1b7d-4078-83df-2a8d4c674195 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:51.565790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 161/327] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:51 2022] GET /identity/v3/users/1f77e22423c5497eb747f35fab773d8f => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:51.572042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818df4cb-5a11-4a78-889f-3d23f3e52752 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:51.577004 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0d202-2305-4b73-b1cc-db74c935b89b None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:51.577209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0d202-2305-4b73-b1cc-db74c935b89b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:51.577488 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0d202-2305-4b73-b1cc-db74c935b89b None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:51.579677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 162/328] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:51.585276 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167bf57-bd7f-4970-9357-ca9899ac02a0 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:51.585740 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167bf57-bd7f-4970-9357-ca9899ac02a0 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:51.586253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167bf57-bd7f-4970-9357-ca9899ac02a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:51.608500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-f167bf57-bd7f-4970-9357-ca9899ac02a0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:51.609721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-f167bf57-bd7f-4970-9357-ca9899ac02a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:51.702190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:51.732628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 163/329] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:09:51.749032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818df4cb-5a11-4a78-889f-3d23f3e52752 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:51.773780 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167bf57-bd7f-4970-9357-ca9899ac02a0 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:51.802468 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe4248-eb7a-4ac3-a0b4-e78430ba73e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:51.803211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe4248-eb7a-4ac3-a0b4-e78430ba73e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:51.803497 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe4248-eb7a-4ac3-a0b4-e78430ba73e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:51.804304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe4248-eb7a-4ac3-a0b4-e78430ba73e4 None admin] PATH_INFO: `/v3/system/users/1f77e22423c5497eb747f35fab773d8f/roles/39c9e7be022744fc9a349364ef6ce2d0` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:51.805840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe4248-eb7a-4ac3-a0b4-e78430ba73e4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1f77e22423c5497eb747f35fab773d8f, role_id=39c9e7be022744fc9a349364ef6ce2d0)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:51.807282 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe4248-eb7a-4ac3-a0b4-e78430ba73e4 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:51.823052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 167/330] 10.222.0.57 () {58 vars in 1334 bytes} [Tue Aug 2 08:09:51 2022] PUT /identity/v3/system/users/1f77e22423c5497eb747f35fab773d8f/roles/39c9e7be022744fc9a349364ef6ce2d0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:09:51.888303 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:51.915852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167bf57-bd7f-4970-9357-ca9899ac02a0 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:51.957373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a954-5aca-489d-bdcf-c85ca6a80e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:51.958072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a954-5aca-489d-bdcf-c85ca6a80e86 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:51.958354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a954-5aca-489d-bdcf-c85ca6a80e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:51.958627 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a954-5aca-489d-bdcf-c85ca6a80e86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:51.971407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82a954-5aca-489d-bdcf-c85ca6a80e86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-1e82a954-5aca-489d-bdcf-c85ca6a80e86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:51.977005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:51.977951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:51.978777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 164/331] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:51.984699 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe4248-eb7a-4ac3-a0b4-e78430ba73e4 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:52.102893 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe4248-eb7a-4ac3-a0b4-e78430ba73e4 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:52.144226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061e611-d891-46cd-81e3-1a4c95e8fa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:52.144772 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061e611-d891-46cd-81e3-1a4c95e8fa36 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:52.145050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061e611-d891-46cd-81e3-1a4c95e8fa36 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:52.145320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061e611-d891-46cd-81e3-1a4c95e8fa36 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:52.146262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061e611-d891-46cd-81e3-1a4c95e8fa36 None admin] RBAC: Adding query filter params (name=member) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:52.146569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061e611-d891-46cd-81e3-1a4c95e8fa36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:52.147945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061e611-d891-46cd-81e3-1a4c95e8fa36 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:52.157288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 168/332] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:52.162905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a954-5aca-489d-bdcf-c85ca6a80e86 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:52.283069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a954-5aca-489d-bdcf-c85ca6a80e86 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:52.329431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88716ffc-bda3-472b-add4-c7ccc90fcfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:52.330101 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716ffc-bda3-472b-add4-c7ccc90fcfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:52.330385 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716ffc-bda3-472b-add4-c7ccc90fcfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:52.330656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716ffc-bda3-472b-add4-c7ccc90fcfb4 None admin] PATH_INFO: `/v3/users/0a71ec6ff5aa4593856e510017c60fca` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:52.331928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88716ffc-bda3-472b-add4-c7ccc90fcfb4 None admin] RBAC: Authorizing `identity:get_user(user_id=0a71ec6ff5aa4593856e510017c60fca)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:52.333361 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88716ffc-bda3-472b-add4-c7ccc90fcfb4 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:52.335260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 165/333] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:52 2022] GET /identity/v3/users/0a71ec6ff5aa4593856e510017c60fca => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:52.340971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061e611-d891-46cd-81e3-1a4c95e8fa36 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:52.345490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:52.477011 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061e611-d891-46cd-81e3-1a4c95e8fa36 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:52.519295 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df526f-dc4e-45f6-a6ea-c8d4556f91d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:52.520327 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df526f-dc4e-45f6-a6ea-c8d4556f91d0 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:52.520917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df526f-dc4e-45f6-a6ea-c8d4556f91d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:52.521410 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df526f-dc4e-45f6-a6ea-c8d4556f91d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:52.522453 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df526f-dc4e-45f6-a6ea-c8d4556f91d0 None admin] RBAC: Adding query filter params (role.id=a4aae8b3b8b4486389006b0d25566eb6, user.id=0a71ec6ff5aa4593856e510017c60fca, scope.system=all) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:52.522974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df526f-dc4e-45f6-a6ea-c8d4556f91d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:52.524784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df526f-dc4e-45f6-a6ea-c8d4556f91d0 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:52.539213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 169/334] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 2 08:09:52 2022] GET /identity/v3/role_assignments?user.id=0a71ec6ff5aa4593856e510017c60fca&scope.system=all&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:53.380042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e5b8-ec9a-475b-ae36-df136e46f767 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:53.380549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e5b8-ec9a-475b-ae36-df136e46f767 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:53.380624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783e5b8-ec9a-475b-ae36-df136e46f767 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:53.382123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 166/335] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:53.387672 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e309ab-503c-455f-9d8e-5dcb6e1402ce None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:53.388592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e309ab-503c-455f-9d8e-5dcb6e1402ce None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:53.389070 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e309ab-503c-455f-9d8e-5dcb6e1402ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:53.419060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-c6e309ab-503c-455f-9d8e-5dcb6e1402ce None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:53.420620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c6e309ab-503c-455f-9d8e-5dcb6e1402ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:53.487583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:53.504576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 170/336] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:53.543568 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e5b8-ec9a-475b-ae36-df136e46f767 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:53.555947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:53.679759 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783e5b8-ec9a-475b-ae36-df136e46f767 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:53.722089 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed2a3-7eed-4e70-8e60-88af8b22200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:53.723126 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed2a3-7eed-4e70-8e60-88af8b22200a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:53.723598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed2a3-7eed-4e70-8e60-88af8b22200a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:53.724060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed2a3-7eed-4e70-8e60-88af8b22200a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:53.739902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ed2a3-7eed-4e70-8e60-88af8b22200a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-503ed2a3-7eed-4e70-8e60-88af8b22200a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:53.745274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:53.746156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:53.747116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:53.749383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 167/337] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:53.755110 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e309ab-503c-455f-9d8e-5dcb6e1402ce None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:53.871306 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e309ab-503c-455f-9d8e-5dcb6e1402ce None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:53.914140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee50017-54a6-43f2-b38d-e79f36350570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:53.915191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50017-54a6-43f2-b38d-e79f36350570 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:53.915619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50017-54a6-43f2-b38d-e79f36350570 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:53.916287 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50017-54a6-43f2-b38d-e79f36350570 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:53.917193 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee50017-54a6-43f2-b38d-e79f36350570 None admin] RBAC: Adding query filter params (name=member) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:53.917664 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee50017-54a6-43f2-b38d-e79f36350570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:53.919269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee50017-54a6-43f2-b38d-e79f36350570 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:53.929708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 171/338] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:53.935491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed2a3-7eed-4e70-8e60-88af8b22200a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:54.012368 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:54.050392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ed2a3-7eed-4e70-8e60-88af8b22200a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:54.091679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5f9e7-4422-4a8e-bef0-8aa086a3cc13 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:54.092205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5f9e7-4422-4a8e-bef0-8aa086a3cc13 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:54.092627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5f9e7-4422-4a8e-bef0-8aa086a3cc13 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:54.094778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 172/339] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:54.098574 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139da4da-e4f1-4a4d-a2c2-f470ad71a76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:54.099479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139da4da-e4f1-4a4d-a2c2-f470ad71a76e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:54.101038 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3038e-cf99-4919-8c7a-7a93eec25f1e None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:54.101474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3038e-cf99-4919-8c7a-7a93eec25f1e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:54.101885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3038e-cf99-4919-8c7a-7a93eec25f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:54.107577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139da4da-e4f1-4a4d-a2c2-f470ad71a76e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:54.110887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139da4da-e4f1-4a4d-a2c2-f470ad71a76e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:54.135050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-e5b3038e-cf99-4919-8c7a-7a93eec25f1e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:54.136591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e5b3038e-cf99-4919-8c7a-7a93eec25f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:54.203975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139da4da-e4f1-4a4d-a2c2-f470ad71a76e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:54.205386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139da4da-e4f1-4a4d-a2c2-f470ad71a76e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:54.219698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:54.252914 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 173/340] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:54.293754 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:54.296426 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3038e-cf99-4919-8c7a-7a93eec25f1e None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:54.356301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 168/341] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:54.356936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139da4da-e4f1-4a4d-a2c2-f470ad71a76e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:54.480902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139da4da-e4f1-4a4d-a2c2-f470ad71a76e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:54.522758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c8d22-4fa4-4ff1-9e62-81110d8c98f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:54.523799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c8d22-4fa4-4ff1-9e62-81110d8c98f3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:54.524273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c8d22-4fa4-4ff1-9e62-81110d8c98f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:54.524755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c8d22-4fa4-4ff1-9e62-81110d8c98f3 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:54.530832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c8d22-4fa4-4ff1-9e62-81110d8c98f3 None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:54.532530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c8d22-4fa4-4ff1-9e62-81110d8c98f3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:54.534792 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 169/342] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:54 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:54.540523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c8d22-4fa4-4ff1-9e62-81110d8c98f3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:54.600898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3038e-cf99-4919-8c7a-7a93eec25f1e None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:54.607168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:54.695201 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0217d-034d-47d1-a318-a834c5c2f541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:54.695879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0217d-034d-47d1-a318-a834c5c2f541 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:54.696166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0217d-034d-47d1-a318-a834c5c2f541 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:54.696447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0217d-034d-47d1-a318-a834c5c2f541 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:54.714701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0217d-034d-47d1-a318-a834c5c2f541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-d4c0217d-034d-47d1-a318-a834c5c2f541 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:54.720859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:54.721785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:54.722601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:54.726123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 174/343] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:09:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:54.728365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0217d-034d-47d1-a318-a834c5c2f541 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:54.751688 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c8d22-4fa4-4ff1-9e62-81110d8c98f3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:54.811333 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:54.827270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17e0c6-1ee0-4cee-87e9-c3b1b048d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:54.828087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17e0c6-1ee0-4cee-87e9-c3b1b048d1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:54.828411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17e0c6-1ee0-4cee-87e9-c3b1b048d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:54.828701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17e0c6-1ee0-4cee-87e9-c3b1b048d1a0 None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:54.840845 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17e0c6-1ee0-4cee-87e9-c3b1b048d1a0 None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:54.842511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17e0c6-1ee0-4cee-87e9-c3b1b048d1a0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:54.844597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 170/344] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:09:54 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:54.850635 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17e0c6-1ee0-4cee-87e9-c3b1b048d1a0 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:54.916420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0217d-034d-47d1-a318-a834c5c2f541 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:54.995419 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254c549-ec47-453f-89df-191a765eb64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:54.996067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c549-ec47-453f-89df-191a765eb64a None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:54.996352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c549-ec47-453f-89df-191a765eb64a None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:54.996630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254c549-ec47-453f-89df-191a765eb64a None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:54.997414 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254c549-ec47-453f-89df-191a765eb64a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:54.997788 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254c549-ec47-453f-89df-191a765eb64a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:54.999443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254c549-ec47-453f-89df-191a765eb64a None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:55.013770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 175/345] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:09:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:55.019322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254c549-ec47-453f-89df-191a765eb64a None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:55.034362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:55.039966 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17e0c6-1ee0-4cee-87e9-c3b1b048d1a0 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:55.120982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed3b4d-c8d2-4441-8cb3-b45b55d9dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:55.121664 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed3b4d-c8d2-4441-8cb3-b45b55d9dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:55.121948 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed3b4d-c8d2-4441-8cb3-b45b55d9dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:55.122252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed3b4d-c8d2-4441-8cb3-b45b55d9dbd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:55.123070 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed3b4d-c8d2-4441-8cb3-b45b55d9dbd8 None admin] RBAC: Adding query filter params (group.id=11aa10fe6f70400cac8e79157430350d, role.id=a4aae8b3b8b4486389006b0d25566eb6, scope.project.id=85dec1bdd87547f7b0d6bdc818811672) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:55.123385 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed3b4d-c8d2-4441-8cb3-b45b55d9dbd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:55.124958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed3b4d-c8d2-4441-8cb3-b45b55d9dbd8 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:55.139241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 171/346] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 08:09:54 2022] GET /identity/v3/role_assignments?group.id=11aa10fe6f70400cac8e79157430350d&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 260 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:55.188103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254c549-ec47-453f-89df-191a765eb64a None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:55.201045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:55.237059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6fd22-82d8-4ea7-bfe6-8d3c0b5f203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:55.237713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6fd22-82d8-4ea7-bfe6-8d3c0b5f203e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:55.237998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6fd22-82d8-4ea7-bfe6-8d3c0b5f203e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:55.238299 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6fd22-82d8-4ea7-bfe6-8d3c0b5f203e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:55.331544 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6fd22-82d8-4ea7-bfe6-8d3c0b5f203e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:55.332944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6fd22-82d8-4ea7-bfe6-8d3c0b5f203e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:55.470295 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 176/347] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:09:55.476340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed3b4d-c8d2-4441-8cb3-b45b55d9dbd8 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:55.507117 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c925-7183-41d3-83d5-123692264344 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:55.507435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c925-7183-41d3-83d5-123692264344 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:55.507679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c925-7183-41d3-83d5-123692264344 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:55.509065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 177/348] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:55.515376 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabfcc8-1d86-4487-8721-f4f44bac411f None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:55.516204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabfcc8-1d86-4487-8721-f4f44bac411f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:55.516485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabfcc8-1d86-4487-8721-f4f44bac411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:55.550877 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:55.560616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-aaabfcc8-1d86-4487-8721-f4f44bac411f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:55.561926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-aaabfcc8-1d86-4487-8721-f4f44bac411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:55.665296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed3b4d-c8d2-4441-8cb3-b45b55d9dbd8 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:55.668830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 178/349] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 02 08:09:55.670359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cbb5f-ed5e-4bc1-8843-1d0fd6384f07 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:55.670574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cbb5f-ed5e-4bc1-8843-1d0fd6384f07 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:55.670844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cbb5f-ed5e-4bc1-8843-1d0fd6384f07 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:55.675126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 179/350] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:55.675126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08edea-b0ee-4731-9aa5-4c163d77c658 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:55.675126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08edea-b0ee-4731-9aa5-4c163d77c658 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:55.675126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08edea-b0ee-4731-9aa5-4c163d77c658 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:55.679585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 180/351] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:55.680682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709f0da-c847-4c85-92bc-7061f1d48456 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:55.680969 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709f0da-c847-4c85-92bc-7061f1d48456 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:55.681234 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709f0da-c847-4c85-92bc-7061f1d48456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:55.705872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-a709f0da-c847-4c85-92bc-7061f1d48456 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:55.707274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-a709f0da-c847-4c85-92bc-7061f1d48456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:55.718676 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06335444-5f58-418a-8aa6-6b81a3aecbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:55.720100 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335444-5f58-418a-8aa6-6b81a3aecbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:55.720613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335444-5f58-418a-8aa6-6b81a3aecbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:55.721101 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06335444-5f58-418a-8aa6-6b81a3aecbb1 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:55.723014 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335444-5f58-418a-8aa6-6b81a3aecbb1 None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:55.725524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06335444-5f58-418a-8aa6-6b81a3aecbb1 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:55.733155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 172/352] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:55 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:55.733155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f7a7-0c41-42b0-85cc-4a8d94b45f6b None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:55.733155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f7a7-0c41-42b0-85cc-4a8d94b45f6b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:55.733155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7f7a7-0c41-42b0-85cc-4a8d94b45f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:55.759253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-9eb7f7a7-0c41-42b0-85cc-4a8d94b45f6b None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:55.760907 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9eb7f7a7-0c41-42b0-85cc-4a8d94b45f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:55.798896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:55.803747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 181/353] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:55.803747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709f0da-c847-4c85-92bc-7061f1d48456 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:55.879708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 173/354] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:55.880675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7f7a7-0c41-42b0-85cc-4a8d94b45f6b None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:55.914586 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:55.965165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709f0da-c847-4c85-92bc-7061f1d48456 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:56.018314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad583072-3ea6-4961-ba82-0560ad2d3e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:56.019413 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583072-3ea6-4961-ba82-0560ad2d3e5e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.019898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583072-3ea6-4961-ba82-0560ad2d3e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.020361 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583072-3ea6-4961-ba82-0560ad2d3e5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.026291 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7f7a7-0c41-42b0-85cc-4a8d94b45f6b None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:56.035008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad583072-3ea6-4961-ba82-0560ad2d3e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-ad583072-3ea6-4961-ba82-0560ad2d3e5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:56.042448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:56.043493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 182/355] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:56.044980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad583072-3ea6-4961-ba82-0560ad2d3e5e None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:56.078764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beefe8c-8843-407d-8448-ee2f04789e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:56.079431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beefe8c-8843-407d-8448-ee2f04789e11 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.079710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beefe8c-8843-407d-8448-ee2f04789e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.079983 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beefe8c-8843-407d-8448-ee2f04789e11 None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.082345 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beefe8c-8843-407d-8448-ee2f04789e11 None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:56.088525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beefe8c-8843-407d-8448-ee2f04789e11 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:56.088525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 174/356] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:09:55 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:56.088525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beefe8c-8843-407d-8448-ee2f04789e11 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:56.130473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:56.175998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad583072-3ea6-4961-ba82-0560ad2d3e5e None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:56.215593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:56.228007 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e01a7-ea6f-4606-867e-33afade1c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:56.229093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e01a7-ea6f-4606-867e-33afade1c1fc None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.229576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e01a7-ea6f-4606-867e-33afade1c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.229686 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beefe8c-8843-407d-8448-ee2f04789e11 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:56.230185 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e01a7-ea6f-4606-867e-33afade1c1fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.243022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e01a7-ea6f-4606-867e-33afade1c1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-c60e01a7-ea6f-4606-867e-33afade1c1fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:56.248913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:56.249819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 08:09:56.251257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:56.254149 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 183/357] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:56.255340 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e01a7-ea6f-4606-867e-33afade1c1fc None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:56.277568 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4055333-bde2-4674-a931-eb98bbf03e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:56.278269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4055333-bde2-4674-a931-eb98bbf03e9e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.278548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4055333-bde2-4674-a931-eb98bbf03e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.278820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4055333-bde2-4674-a931-eb98bbf03e9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.294105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4055333-bde2-4674-a931-eb98bbf03e9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-e4055333-bde2-4674-a931-eb98bbf03e9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:56.303093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:56.304162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:09:56.305069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 175/358] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:09:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:56.305747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4055333-bde2-4674-a931-eb98bbf03e9e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:56.396478 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e01a7-ea6f-4606-867e-33afade1c1fc None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:56.429809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:56.444625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4055333-bde2-4674-a931-eb98bbf03e9e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:56.446828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae0421-dbc7-49ea-924f-aa2a22d949cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:56.447470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae0421-dbc7-49ea-924f-aa2a22d949cb None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.447754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae0421-dbc7-49ea-924f-aa2a22d949cb None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.448030 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae0421-dbc7-49ea-924f-aa2a22d949cb None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.448864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae0421-dbc7-49ea-924f-aa2a22d949cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:56.449250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae0421-dbc7-49ea-924f-aa2a22d949cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:56.450654 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aae0421-dbc7-49ea-924f-aa2a22d949cb None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:56.460608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 184/359] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:56.461462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae0421-dbc7-49ea-924f-aa2a22d949cb None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:56.493320 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84221cc-ae01-4aec-818f-5a4515221b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:56.493891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84221cc-ae01-4aec-818f-5a4515221b1c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.494251 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84221cc-ae01-4aec-818f-5a4515221b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.494533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84221cc-ae01-4aec-818f-5a4515221b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.495343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84221cc-ae01-4aec-818f-5a4515221b1c None admin] RBAC: Adding query filter params (group.id=11aa10fe6f70400cac8e79157430350d, role.id=e1f4e92f38534e1d80123b0beaa2be47, scope.project.id=85dec1bdd87547f7b0d6bdc818811672) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:56.495655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84221cc-ae01-4aec-818f-5a4515221b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:56.497096 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84221cc-ae01-4aec-818f-5a4515221b1c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:56.504218 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 176/360] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 08:09:56 2022] GET /identity/v3/role_assignments?group.id=11aa10fe6f70400cac8e79157430350d&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=e1f4e92f38534e1d80123b0beaa2be47 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:56.504777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84221cc-ae01-4aec-818f-5a4515221b1c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:56.542228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:56.623079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae0421-dbc7-49ea-924f-aa2a22d949cb None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:56.645472 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84221cc-ae01-4aec-818f-5a4515221b1c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:56.671576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7e5bc-333d-4143-9f98-916f870c015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:56.672770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e5bc-333d-4143-9f98-916f870c015f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.673106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e5bc-333d-4143-9f98-916f870c015f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.673786 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e5bc-333d-4143-9f98-916f870c015f None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.674561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7e5bc-333d-4143-9f98-916f870c015f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:56.674866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7e5bc-333d-4143-9f98-916f870c015f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:56.676283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7e5bc-333d-4143-9f98-916f870c015f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:56.688476 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 185/361] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:56.690079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce7435-0607-4a54-aac2-5e37e900e032 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.690388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce7435-0607-4a54-aac2-5e37e900e032 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.690668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce7435-0607-4a54-aac2-5e37e900e032 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.693396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 186/362] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:56.694165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce7435-0607-4a54-aac2-5e37e900e032 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:56.697281 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e48399-ce9f-43d3-95b2-398b7a89b5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:56.698031 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e48399-ce9f-43d3-95b2-398b7a89b5da None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.698308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e48399-ce9f-43d3-95b2-398b7a89b5da None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.698592 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e48399-ce9f-43d3-95b2-398b7a89b5da None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.699668 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e48399-ce9f-43d3-95b2-398b7a89b5da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:56.699935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e48399-ce9f-43d3-95b2-398b7a89b5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:56.701366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e48399-ce9f-43d3-95b2-398b7a89b5da None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:56.712649 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 177/363] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:09:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:56.713994 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e48399-ce9f-43d3-95b2-398b7a89b5da None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:56.740318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:56.841799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce7435-0607-4a54-aac2-5e37e900e032 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:56.853696 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e48399-ce9f-43d3-95b2-398b7a89b5da None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:56.858922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:56.893661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26447b4-6fdf-4c97-8d12-8abdf137126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:56.894352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26447b4-6fdf-4c97-8d12-8abdf137126c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.894645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26447b4-6fdf-4c97-8d12-8abdf137126c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.894914 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26447b4-6fdf-4c97-8d12-8abdf137126c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.900852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61405dd-4ee3-4d8c-9e52-365ad1695c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:56.901471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61405dd-4ee3-4d8c-9e52-365ad1695c1b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.901753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61405dd-4ee3-4d8c-9e52-365ad1695c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.902061 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61405dd-4ee3-4d8c-9e52-365ad1695c1b None admin] PATH_INFO: `/v3/users/1f77e22423c5497eb747f35fab773d8f` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.903256 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61405dd-4ee3-4d8c-9e52-365ad1695c1b None admin] RBAC: Authorizing `identity:get_user(user_id=1f77e22423c5497eb747f35fab773d8f)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:56.904799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61405dd-4ee3-4d8c-9e52-365ad1695c1b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:56.907160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 178/364] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:09:56 2022] GET /identity/v3/users/1f77e22423c5497eb747f35fab773d8f => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:56.908309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7a64-5ca5-4908-ab28-f47c00f00185 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:56.908598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7a64-5ca5-4908-ab28-f47c00f00185 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:56.908877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7a64-5ca5-4908-ab28-f47c00f00185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:56.930197 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-26ee7a64-5ca5-4908-ab28-f47c00f00185 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:56.931528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-26ee7a64-5ca5-4908-ab28-f47c00f00185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:56.977474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26447b4-6fdf-4c97-8d12-8abdf137126c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:56.978971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26447b4-6fdf-4c97-8d12-8abdf137126c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:57.016133 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 179/365] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:57.018030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee7a64-5ca5-4908-ab28-f47c00f00185 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:57.041364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:57.108462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 187/366] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:57.109977 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26447b4-6fdf-4c97-8d12-8abdf137126c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:57.123273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:57.149788 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee7a64-5ca5-4908-ab28-f47c00f00185 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:57.203905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825fcbf-0de8-4fe0-baa3-e2d3af7e3d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:57.204580 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825fcbf-0de8-4fe0-baa3-e2d3af7e3d15 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:57.204863 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825fcbf-0de8-4fe0-baa3-e2d3af7e3d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:57.205143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825fcbf-0de8-4fe0-baa3-e2d3af7e3d15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:57.224873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26447b4-6fdf-4c97-8d12-8abdf137126c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:57.268094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8d650-8c3a-49f2-8ea5-9bdb0278273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:57.268728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8d650-8c3a-49f2-8ea5-9bdb0278273d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:57.269010 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8d650-8c3a-49f2-8ea5-9bdb0278273d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:57.269285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8d650-8c3a-49f2-8ea5-9bdb0278273d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:57.270111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8d650-8c3a-49f2-8ea5-9bdb0278273d None admin] RBAC: Adding query filter params (role.id=39c9e7be022744fc9a349364ef6ce2d0, user.id=1f77e22423c5497eb747f35fab773d8f, scope.system=all) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:57.270426 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8d650-8c3a-49f2-8ea5-9bdb0278273d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:57.271863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8d650-8c3a-49f2-8ea5-9bdb0278273d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:57.287285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 188/367] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 2 08:09:57 2022] GET /identity/v3/role_assignments?user.id=1f77e22423c5497eb747f35fab773d8f&scope.system=all&role.id=39c9e7be022744fc9a349364ef6ce2d0 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:57.288159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8d650-8c3a-49f2-8ea5-9bdb0278273d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:57.302441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825fcbf-0de8-4fe0-baa3-e2d3af7e3d15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:57.304402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825fcbf-0de8-4fe0-baa3-e2d3af7e3d15 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:57.322807 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:57.436344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 180/368] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:57.437197 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825fcbf-0de8-4fe0-baa3-e2d3af7e3d15 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:57.473471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:57.501954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8d650-8c3a-49f2-8ea5-9bdb0278273d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:57.555392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825fcbf-0de8-4fe0-baa3-e2d3af7e3d15 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:57.566586 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ae088-b0ea-4336-bdc7-b35785c37c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:57.568025 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ae088-b0ea-4336-bdc7-b35785c37c4c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:57.568834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ae088-b0ea-4336-bdc7-b35785c37c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:57.569346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ae088-b0ea-4336-bdc7-b35785c37c4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:57.571696 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:57.586617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ae088-b0ea-4336-bdc7-b35785c37c4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-c89ae088-b0ea-4336-bdc7-b35785c37c4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:57.592250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:57.593163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:09:57.594602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:57.598162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 189/369] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:09:57.598993 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ae088-b0ea-4336-bdc7-b35785c37c4c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:57.608144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8e3bd-7abe-4ad7-9402-055a2adfc00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:57.609132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8e3bd-7abe-4ad7-9402-055a2adfc00d None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:57.610313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8e3bd-7abe-4ad7-9402-055a2adfc00d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:57.610802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a8e3bd-7abe-4ad7-9402-055a2adfc00d None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:57.612699 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8e3bd-7abe-4ad7-9402-055a2adfc00d None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:57.614955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a8e3bd-7abe-4ad7-9402-055a2adfc00d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:57.618155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 181/370] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:57 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:57.619185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8e3bd-7abe-4ad7-9402-055a2adfc00d None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:57.723356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ae088-b0ea-4336-bdc7-b35785c37c4c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:57.757265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:57.766292 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a8e3bd-7abe-4ad7-9402-055a2adfc00d None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:57.768060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530851d-0e78-4d96-b3e2-59fea49c995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:57.768839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530851d-0e78-4d96-b3e2-59fea49c995f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:57.769225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530851d-0e78-4d96-b3e2-59fea49c995f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:57.769603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530851d-0e78-4d96-b3e2-59fea49c995f None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:57.771046 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530851d-0e78-4d96-b3e2-59fea49c995f None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:57.772694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530851d-0e78-4d96-b3e2-59fea49c995f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:57.775218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 190/371] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:57 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:57.776691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530851d-0e78-4d96-b3e2-59fea49c995f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:57.814758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b9189-4e63-42f1-861b-90c30513cd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:57.818057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b9189-4e63-42f1-861b-90c30513cd2a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:57.818798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b9189-4e63-42f1-861b-90c30513cd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:57.819228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b9189-4e63-42f1-861b-90c30513cd2a None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:57.821256 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b9189-4e63-42f1-861b-90c30513cd2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:57.821736 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b9189-4e63-42f1-861b-90c30513cd2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:57.824439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b9189-4e63-42f1-861b-90c30513cd2a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:57.837229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 182/372] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:57.840970 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b9189-4e63-42f1-861b-90c30513cd2a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:57.896436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:57.918183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530851d-0e78-4d96-b3e2-59fea49c995f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:57.962492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b9189-4e63-42f1-861b-90c30513cd2a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:57.963419 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8d2e-c82c-4215-874c-7809097b60d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:57.964293 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8d2e-c82c-4215-874c-7809097b60d2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:57.964742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8d2e-c82c-4215-874c-7809097b60d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:57.965023 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8d2e-c82c-4215-874c-7809097b60d2 None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:57.966233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8d2e-c82c-4215-874c-7809097b60d2 None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:57.967688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8d2e-c82c-4215-874c-7809097b60d2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:57.969528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 191/373] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:09:57 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:57.970663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8d2e-c82c-4215-874c-7809097b60d2 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:58.003188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e2925-3ab7-4198-9184-5eceac9e5e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:58.003188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2925-3ab7-4198-9184-5eceac9e5e2b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:58.003188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2925-3ab7-4198-9184-5eceac9e5e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:58.003534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e2925-3ab7-4198-9184-5eceac9e5e2b None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:58.005381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e2925-3ab7-4198-9184-5eceac9e5e2b None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:58.006809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e2925-3ab7-4198-9184-5eceac9e5e2b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:58.009008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 183/374] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:09:57 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:58.011356 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f2b2-7f86-4fd7-9dfd-d217501253ab None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:58.011655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f2b2-7f86-4fd7-9dfd-d217501253ab None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:58.011932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619f2b2-7f86-4fd7-9dfd-d217501253ab None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:58.013394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 184/375] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:58.014168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f2b2-7f86-4fd7-9dfd-d217501253ab None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:58.049628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:58.101251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8d2e-c82c-4215-874c-7809097b60d2 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:58.145360 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4ce85-920e-467e-be86-7e781afbcb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:58.146121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ce85-920e-467e-be86-7e781afbcb5d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:58.146522 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ce85-920e-467e-be86-7e781afbcb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:58.146803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ce85-920e-467e-be86-7e781afbcb5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:58.148024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619f2b2-7f86-4fd7-9dfd-d217501253ab None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:58.162814 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:58.190965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c6058-b4f8-473a-a76b-ecb71ff01cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:58.191597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c6058-b4f8-473a-a76b-ecb71ff01cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:58.191876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c6058-b4f8-473a-a76b-ecb71ff01cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:58.192147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c6058-b4f8-473a-a76b-ecb71ff01cb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:58.192935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c6058-b4f8-473a-a76b-ecb71ff01cb3 None admin] RBAC: Adding query filter params (group.id=11aa10fe6f70400cac8e79157430350d, role.id=a4aae8b3b8b4486389006b0d25566eb6, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:58.193243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c6058-b4f8-473a-a76b-ecb71ff01cb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:58.195462 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c6058-b4f8-473a-a76b-ecb71ff01cb3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:58.202282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 185/376] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 08:09:58 2022] GET /identity/v3/role_assignments?group.id=11aa10fe6f70400cac8e79157430350d&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:58.203000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c6058-b4f8-473a-a76b-ecb71ff01cb3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:58.247164 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4ce85-920e-467e-be86-7e781afbcb5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:58.250400 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4ce85-920e-467e-be86-7e781afbcb5d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:58.333766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:58.361952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c6058-b4f8-473a-a76b-ecb71ff01cb3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:58.393885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 192/377] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:09:58.395933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed323e45-3002-405c-b175-e7747463438e None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:58.396371 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed323e45-3002-405c-b175-e7747463438e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:58.396990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed323e45-3002-405c-b175-e7747463438e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:58.405823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c20c8-1b9e-4dbc-af94-a16ee18ab47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:58.406107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c20c8-1b9e-4dbc-af94-a16ee18ab47a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:58.406444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c20c8-1b9e-4dbc-af94-a16ee18ab47a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:58.406815 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c20c8-1b9e-4dbc-af94-a16ee18ab47a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:58.407717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c20c8-1b9e-4dbc-af94-a16ee18ab47a None admin] RBAC: Adding query filter params (group.id=11aa10fe6f70400cac8e79157430350d, role.id=e1f4e92f38534e1d80123b0beaa2be47, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:58.408125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c20c8-1b9e-4dbc-af94-a16ee18ab47a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:58.409644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c20c8-1b9e-4dbc-af94-a16ee18ab47a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:58.416823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 186/378] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 08:09:58 2022] GET /identity/v3/role_assignments?group.id=11aa10fe6f70400cac8e79157430350d&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=e1f4e92f38534e1d80123b0beaa2be47 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:58.422241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c20c8-1b9e-4dbc-af94-a16ee18ab47a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:58.423373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-ed323e45-3002-405c-b175-e7747463438e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:58.424616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ed323e45-3002-405c-b175-e7747463438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:58.520765 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:58.569020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 193/379] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:58.596706 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed323e45-3002-405c-b175-e7747463438e None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:58.599681 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c20c8-1b9e-4dbc-af94-a16ee18ab47a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:58.643950 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9892ae-8ab1-46a0-9654-22ef9aff7139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:58.644613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9892ae-8ab1-46a0-9654-22ef9aff7139 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:58.644908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9892ae-8ab1-46a0-9654-22ef9aff7139 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:58.645190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9892ae-8ab1-46a0-9654-22ef9aff7139 None admin] PATH_INFO: `/v3/projects/255cf96e6d4c4f0180d3f193cc9e8b40` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:58.646846 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9892ae-8ab1-46a0-9654-22ef9aff7139 None admin] RBAC: Authorizing `identity:get_project(project_id=255cf96e6d4c4f0180d3f193cc9e8b40)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:58.649004 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9892ae-8ab1-46a0-9654-22ef9aff7139 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:58.651296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 187/380] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:58 2022] GET /identity/v3/projects/255cf96e6d4c4f0180d3f193cc9e8b40 => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:58.658995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9892ae-8ab1-46a0-9654-22ef9aff7139 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:58.758785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:58.765737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed323e45-3002-405c-b175-e7747463438e None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:58.808803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9699f-92a1-429e-b848-915ff53da272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:58.809461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9699f-92a1-429e-b848-915ff53da272 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:58.809744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9699f-92a1-429e-b848-915ff53da272 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:58.810037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9699f-92a1-429e-b848-915ff53da272 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:58.820963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9699f-92a1-429e-b848-915ff53da272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-f0d9699f-92a1-429e-b848-915ff53da272 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:58.826187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:58.827257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:58.828289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 194/381] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:09:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:58.835726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9699f-92a1-429e-b848-915ff53da272 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:58.877418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9892ae-8ab1-46a0-9654-22ef9aff7139 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:58.891656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:58.930097 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef4c38-1027-486a-ae8d-277c1e216935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:58.931103 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef4c38-1027-486a-ae8d-277c1e216935 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:58.931591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef4c38-1027-486a-ae8d-277c1e216935 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:58.932069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef4c38-1027-486a-ae8d-277c1e216935 None admin] PATH_INFO: `/v3/groups/43e0589a2ca94ffcbc1facea8b9a3605` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:58.937597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef4c38-1027-486a-ae8d-277c1e216935 None admin] RBAC: Authorizing `identity:get_group(group_id=43e0589a2ca94ffcbc1facea8b9a3605)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:58.939313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef4c38-1027-486a-ae8d-277c1e216935 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:58.944389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 188/382] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:09:58 2022] GET /identity/v3/groups/43e0589a2ca94ffcbc1facea8b9a3605 => generated 229 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:58.945992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073f7c6-dd55-4ede-8057-e22af778b30e None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:58.946545 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073f7c6-dd55-4ede-8057-e22af778b30e None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:58.947058 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073f7c6-dd55-4ede-8057-e22af778b30e None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:58.948936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 189/383] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:09:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:09:58.949849 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073f7c6-dd55-4ede-8057-e22af778b30e None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:59.027981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9699f-92a1-429e-b848-915ff53da272 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:59.079175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fff3e-a700-43c6-a4ad-1459a7bce34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:59.080080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fff3e-a700-43c6-a4ad-1459a7bce34c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:59.080551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fff3e-a700-43c6-a4ad-1459a7bce34c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:59.081036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fff3e-a700-43c6-a4ad-1459a7bce34c None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:59.082158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fff3e-a700-43c6-a4ad-1459a7bce34c None admin] RBAC: Adding query filter params (name=member) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:59.082816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fff3e-a700-43c6-a4ad-1459a7bce34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:59.084067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fff3e-a700-43c6-a4ad-1459a7bce34c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:59.096868 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 195/384] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:09:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:09:59.098587 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bacc65-33bb-4537-ad73-a8bb69b08aaf None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:59.099129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bacc65-33bb-4537-ad73-a8bb69b08aaf None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:59.099619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bacc65-33bb-4537-ad73-a8bb69b08aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:59.099722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073f7c6-dd55-4ede-8057-e22af778b30e None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:59.127234 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-07bacc65-33bb-4537-ad73-a8bb69b08aaf None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:09:59.128501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-07bacc65-33bb-4537-ad73-a8bb69b08aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:09:59.142100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:59.152225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b1203-b6ba-4356-96d9-b2d3d47c6eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:59.152962 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b1203-b6ba-4356-96d9-b2d3d47c6eaf None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:59.153255 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b1203-b6ba-4356-96d9-b2d3d47c6eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:59.153778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b1203-b6ba-4356-96d9-b2d3d47c6eaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:59.154375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b1203-b6ba-4356-96d9-b2d3d47c6eaf None admin] RBAC: Adding query filter params (group.id=43e0589a2ca94ffcbc1facea8b9a3605, role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=255cf96e6d4c4f0180d3f193cc9e8b40) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:59.154693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b1203-b6ba-4356-96d9-b2d3d47c6eaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:59.156208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b1203-b6ba-4356-96d9-b2d3d47c6eaf None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:59.164948 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 190/385] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 08:09:58 2022] GET /identity/v3/role_assignments?group.id=43e0589a2ca94ffcbc1facea8b9a3605&scope.project.id=255cf96e6d4c4f0180d3f193cc9e8b40&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:59.165927 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b1203-b6ba-4356-96d9-b2d3d47c6eaf None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:59.238876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:59.261703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 196/386] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:09:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:09:59.300644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bacc65-33bb-4537-ad73-a8bb69b08aaf None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:59.343673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b1203-b6ba-4356-96d9-b2d3d47c6eaf None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:59.413778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d42bc-ebe5-4a09-829d-3b358f883d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:59.414487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d42bc-ebe5-4a09-829d-3b358f883d31 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:59.414771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d42bc-ebe5-4a09-829d-3b358f883d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:59.415047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d42bc-ebe5-4a09-829d-3b358f883d31 None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:59.416514 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d42bc-ebe5-4a09-829d-3b358f883d31 None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:59.418054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d42bc-ebe5-4a09-829d-3b358f883d31 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:59.419809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 191/387] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:09:59 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:59.428548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d42bc-ebe5-4a09-829d-3b358f883d31 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:59.501227 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bacc65-33bb-4537-ad73-a8bb69b08aaf None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:59.550061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f70cf8-0345-4dfd-a894-b8b19acb1f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:59.550741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f70cf8-0345-4dfd-a894-b8b19acb1f64 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:59.551661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f70cf8-0345-4dfd-a894-b8b19acb1f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:59.551951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f70cf8-0345-4dfd-a894-b8b19acb1f64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:59.567094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f70cf8-0345-4dfd-a894-b8b19acb1f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-b1f70cf8-0345-4dfd-a894-b8b19acb1f64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:09:59.573448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:09:59.574399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:09:59.575218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:09:59.575822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 197/388] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:09:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:09:59.582384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f70cf8-0345-4dfd-a894-b8b19acb1f64 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:59.596749 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:59.678463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d42bc-ebe5-4a09-829d-3b358f883d31 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:59.688436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:59.726647 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f70cf8-0345-4dfd-a894-b8b19acb1f64 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:59.763440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084875a-fe5b-45a4-854d-5da6cd24c04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:59.764026 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084875a-fe5b-45a4-854d-5da6cd24c04a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:59.764306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084875a-fe5b-45a4-854d-5da6cd24c04a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:59.764585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084875a-fe5b-45a4-854d-5da6cd24c04a None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:59.770829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084875a-fe5b-45a4-854d-5da6cd24c04a None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:59.772315 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084875a-fe5b-45a4-854d-5da6cd24c04a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:59.774367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 192/389] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:09:59 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:59.774766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092f763-7410-420b-94e9-c41d64cda879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:59.775974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092f763-7410-420b-94e9-c41d64cda879 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:59.776460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092f763-7410-420b-94e9-c41d64cda879 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:59.776958 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092f763-7410-420b-94e9-c41d64cda879 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:59.777898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092f763-7410-420b-94e9-c41d64cda879 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:09:59.778396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092f763-7410-420b-94e9-c41d64cda879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:59.779901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084875a-fe5b-45a4-854d-5da6cd24c04a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:59.780369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092f763-7410-420b-94e9-c41d64cda879 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:09:59.794692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 198/390] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:09:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:09:59.803066 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092f763-7410-420b-94e9-c41d64cda879 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:09:59.908627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:09:59.910835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084875a-fe5b-45a4-854d-5da6cd24c04a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:59.960193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df82b81-6f45-4a94-b658-f1162ed994a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:09:59.961000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82b81-6f45-4a94-b658-f1162ed994a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:09:59.961280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82b81-6f45-4a94-b658-f1162ed994a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:09:59.961551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df82b81-6f45-4a94-b658-f1162ed994a8 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672/groups/11aa10fe6f70400cac8e79157430350d/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:09:59.964137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092f763-7410-420b-94e9-c41d64cda879 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:09:59.966876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df82b81-6f45-4a94-b658-f1162ed994a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=85dec1bdd87547f7b0d6bdc818811672, group_id=11aa10fe6f70400cac8e79157430350d, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:09:59.968310 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df82b81-6f45-4a94-b658-f1162ed994a8 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:00.003473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 193/391] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 2 08:09:59 2022] PUT /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672/groups/11aa10fe6f70400cac8e79157430350d/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:10:00.029392 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3bbe4-7423-4894-bd06-57d71a243c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:00.030090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3bbe4-7423-4894-bd06-57d71a243c7b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:00.030381 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3bbe4-7423-4894-bd06-57d71a243c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:00.030655 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3bbe4-7423-4894-bd06-57d71a243c7b None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:00.034934 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3bbe4-7423-4894-bd06-57d71a243c7b None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:00.036433 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3bbe4-7423-4894-bd06-57d71a243c7b None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:00.038692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 199/392] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:09:59 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:00.044504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df82b81-6f45-4a94-b658-f1162ed994a8 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:00.095131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:00.188960 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df82b81-6f45-4a94-b658-f1162ed994a8 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:00.226963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b9cab-b46a-4400-808d-7df9579204f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:00.227621 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b9cab-b46a-4400-808d-7df9579204f3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:00.227902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b9cab-b46a-4400-808d-7df9579204f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:00.228177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b9cab-b46a-4400-808d-7df9579204f3 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:00.229334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b9cab-b46a-4400-808d-7df9579204f3 None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:00.230792 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b9cab-b46a-4400-808d-7df9579204f3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:00.232863 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 194/393] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:10:00 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:00.239213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3bbe4-7423-4894-bd06-57d71a243c7b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:00.362575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3bbe4-7423-4894-bd06-57d71a243c7b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:00.400009 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf96b06-fd09-4c47-ab15-5a593f176955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:00.400766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf96b06-fd09-4c47-ab15-5a593f176955 None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:00.401051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf96b06-fd09-4c47-ab15-5a593f176955 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:00.401331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf96b06-fd09-4c47-ab15-5a593f176955 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672/groups/11aa10fe6f70400cac8e79157430350d/roles/e1f4e92f38534e1d80123b0beaa2be47` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:00.403929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf96b06-fd09-4c47-ab15-5a593f176955 None admin] RBAC: Authorizing `identity:create_grant(project_id=85dec1bdd87547f7b0d6bdc818811672, group_id=11aa10fe6f70400cac8e79157430350d, role_id=e1f4e92f38534e1d80123b0beaa2be47)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:00.405538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf96b06-fd09-4c47-ab15-5a593f176955 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:00.412035 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:00.434666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 200/394] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 2 08:10:00 2022] PUT /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672/groups/11aa10fe6f70400cac8e79157430350d/roles/e1f4e92f38534e1d80123b0beaa2be47 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:10:01.007725 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf647b-217a-478f-9f05-f8d34c8cfbb4 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:01.008762 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf647b-217a-478f-9f05-f8d34c8cfbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:01.009256 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf647b-217a-478f-9f05-f8d34c8cfbb4 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:01.010885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 195/395] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:01.018070 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d5b2-95d8-4d98-9580-28aaf47f7ff6 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:01.018969 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d5b2-95d8-4d98-9580-28aaf47f7ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:01.019463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02d5b2-95d8-4d98-9580-28aaf47f7ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:01.041648 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-2a02d5b2-95d8-4d98-9580-28aaf47f7ff6 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:01.043275 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-2a02d5b2-95d8-4d98-9580-28aaf47f7ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:01.102964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51651dd1-4148-4dc2-970e-56add91e9ffc None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:01.103569 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51651dd1-4148-4dc2-970e-56add91e9ffc None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:01.104083 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51651dd1-4148-4dc2-970e-56add91e9ffc None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:01.105602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 196/396] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:01.114076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0bd24-d4a6-4dd4-b8b1-333efdbfd899 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:01.115068 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0bd24-d4a6-4dd4-b8b1-333efdbfd899 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:01.115632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0bd24-d4a6-4dd4-b8b1-333efdbfd899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:01.140365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 201/397] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:01.147471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-cec0bd24-d4a6-4dd4-b8b1-333efdbfd899 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:01.148782 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-cec0bd24-d4a6-4dd4-b8b1-333efdbfd899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:01.174563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d5b2-95d8-4d98-9580-28aaf47f7ff6 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:01.227874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 197/398] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:10:01.314608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02d5b2-95d8-4d98-9580-28aaf47f7ff6 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:01.343737 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0bd24-d4a6-4dd4-b8b1-333efdbfd899 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:01.363963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:01.376796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9057b1d-2cb1-45d2-95eb-ca32906cb196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:01.378339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9057b1d-2cb1-45d2-95eb-ca32906cb196 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:01.378842 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9057b1d-2cb1-45d2-95eb-ca32906cb196 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:01.379311 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9057b1d-2cb1-45d2-95eb-ca32906cb196 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:01.391954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9057b1d-2cb1-45d2-95eb-ca32906cb196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-b9057b1d-2cb1-45d2-95eb-ca32906cb196 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:01.397533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:01.398457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:10:01.399258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:01.406596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 202/399] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:10:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:01.408799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9057b1d-2cb1-45d2-95eb-ca32906cb196 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:01.425783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:01.529469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9057b1d-2cb1-45d2-95eb-ca32906cb196 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:01.570137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b60d7-8d47-411f-85aa-a1bde72e361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:01.571158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b60d7-8d47-411f-85aa-a1bde72e361e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:01.572005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b60d7-8d47-411f-85aa-a1bde72e361e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:01.572631 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b60d7-8d47-411f-85aa-a1bde72e361e None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:01.573573 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b60d7-8d47-411f-85aa-a1bde72e361e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:01.574109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b60d7-8d47-411f-85aa-a1bde72e361e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:01.575677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b60d7-8d47-411f-85aa-a1bde72e361e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:01.585995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 203/400] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:01.591904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b60d7-8d47-411f-85aa-a1bde72e361e None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:01.624444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0bd24-d4a6-4dd4-b8b1-333efdbfd899 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:01.651808 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:01.703078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7287e-bdb0-4e14-a905-4e46aff201b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:01.703786 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7287e-bdb0-4e14-a905-4e46aff201b4 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:01.704008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7287e-bdb0-4e14-a905-4e46aff201b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:01.704285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7287e-bdb0-4e14-a905-4e46aff201b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:01.712148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b60d7-8d47-411f-85aa-a1bde72e361e None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:01.735767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7287e-bdb0-4e14-a905-4e46aff201b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-60f7287e-bdb0-4e14-a905-4e46aff201b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:01.741245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:01.742165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:10:01.742968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:01.746095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 198/401] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:01.749144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7287e-bdb0-4e14-a905-4e46aff201b4 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:01.786883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3758a-bb13-479a-8c20-85ec91eb858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:01.787384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3758a-bb13-479a-8c20-85ec91eb858b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:01.787674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3758a-bb13-479a-8c20-85ec91eb858b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:01.788090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3758a-bb13-479a-8c20-85ec91eb858b None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:01.794740 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3758a-bb13-479a-8c20-85ec91eb858b None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:01.796211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc3758a-bb13-479a-8c20-85ec91eb858b None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:01.798732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 204/402] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:10:01 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:01.806500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3758a-bb13-479a-8c20-85ec91eb858b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:01.862468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:01.870567 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7287e-bdb0-4e14-a905-4e46aff201b4 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:01.918170 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734a30a-bcc2-4b11-8946-3674e4e7aae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:01.919270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734a30a-bcc2-4b11-8946-3674e4e7aae7 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:01.919714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734a30a-bcc2-4b11-8946-3674e4e7aae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:01.920128 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734a30a-bcc2-4b11-8946-3674e4e7aae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:01.921081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734a30a-bcc2-4b11-8946-3674e4e7aae7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:01.922358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734a30a-bcc2-4b11-8946-3674e4e7aae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:01.924430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734a30a-bcc2-4b11-8946-3674e4e7aae7 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:01.936613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 199/403] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:10:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:01.939451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046256b-a5ce-493d-b3df-eccb4aba757b None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:01.939880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046256b-a5ce-493d-b3df-eccb4aba757b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:01.940389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046256b-a5ce-493d-b3df-eccb4aba757b None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:01.942733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 200/404] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:01.943566 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046256b-a5ce-493d-b3df-eccb4aba757b None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:01.971431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3758a-bb13-479a-8c20-85ec91eb858b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:01.993382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:02.017634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e45930-2c47-411b-9442-7b1875e77877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:02.018556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45930-2c47-411b-9442-7b1875e77877 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:02.019412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45930-2c47-411b-9442-7b1875e77877 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:02.019825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45930-2c47-411b-9442-7b1875e77877 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:02.021971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e45930-2c47-411b-9442-7b1875e77877 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:02.023909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e45930-2c47-411b-9442-7b1875e77877 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:02.031674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 205/405] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:10:01 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:02.031674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3f844-fa4b-49e7-a09b-192ac6b780eb None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:02.031674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3f844-fa4b-49e7-a09b-192ac6b780eb None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:02.031674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3f844-fa4b-49e7-a09b-192ac6b780eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:02.058685 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-93f3f844-fa4b-49e7-a09b-192ac6b780eb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:02.060924 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-93f3f844-fa4b-49e7-a09b-192ac6b780eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:02.065976 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046256b-a5ce-493d-b3df-eccb4aba757b None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:02.108620 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5aec78-0bfd-4fe9-8ec7-41f02f47082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:02.109296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5aec78-0bfd-4fe9-8ec7-41f02f47082f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:02.109586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5aec78-0bfd-4fe9-8ec7-41f02f47082f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:02.109902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5aec78-0bfd-4fe9-8ec7-41f02f47082f None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:02.111152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5aec78-0bfd-4fe9-8ec7-41f02f47082f None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:02.113818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5aec78-0bfd-4fe9-8ec7-41f02f47082f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:02.115106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 201/406] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:10:01 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:02.115916 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5aec78-0bfd-4fe9-8ec7-41f02f47082f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:02.148608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:02.168359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 206/407] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:02.169968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3f844-fa4b-49e7-a09b-192ac6b780eb None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:02.330923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5aec78-0bfd-4fe9-8ec7-41f02f47082f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:02.339938 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3f844-fa4b-49e7-a09b-192ac6b780eb None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:02.386433 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:02.389722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020a3d4-dc57-4d00-b1e3-b9fba963d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:02.391188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020a3d4-dc57-4d00-b1e3-b9fba963d00d None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:02.391838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020a3d4-dc57-4d00-b1e3-b9fba963d00d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:02.392417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020a3d4-dc57-4d00-b1e3-b9fba963d00d None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/groups/11aa10fe6f70400cac8e79157430350d/roles/e1f4e92f38534e1d80123b0beaa2be47` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:02.396134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020a3d4-dc57-4d00-b1e3-b9fba963d00d None admin] RBAC: Authorizing `identity:create_grant(project_id=2998613f90a9440da9bf8b1b9eedbb96, group_id=11aa10fe6f70400cac8e79157430350d, role_id=e1f4e92f38534e1d80123b0beaa2be47)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:02.398640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020a3d4-dc57-4d00-b1e3-b9fba963d00d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:02.399749 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfd2a9-d397-43cc-95b5-dd6c63065a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:02.400951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfd2a9-d397-43cc-95b5-dd6c63065a12 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:02.401574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfd2a9-d397-43cc-95b5-dd6c63065a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:02.402262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfd2a9-d397-43cc-95b5-dd6c63065a12 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:02.404526 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfd2a9-d397-43cc-95b5-dd6c63065a12 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:02.407854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfd2a9-d397-43cc-95b5-dd6c63065a12 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:02.410847 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 207/408] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:10:02 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:02.412120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfd2a9-d397-43cc-95b5-dd6c63065a12 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:02.424156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 202/409] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 2 08:10:02 2022] PUT /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/groups/11aa10fe6f70400cac8e79157430350d/roles/e1f4e92f38534e1d80123b0beaa2be47 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:10:02.426257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020a3d4-dc57-4d00-b1e3-b9fba963d00d None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:02.577909 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:02.592356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfd2a9-d397-43cc-95b5-dd6c63065a12 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:02.619289 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020a3d4-dc57-4d00-b1e3-b9fba963d00d None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:02.652947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10311cae-8e40-4334-862e-082899231c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:02.653966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10311cae-8e40-4334-862e-082899231c7f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:02.654490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10311cae-8e40-4334-862e-082899231c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:02.654952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10311cae-8e40-4334-862e-082899231c7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:02.674934 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10311cae-8e40-4334-862e-082899231c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:02.684494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2067133-95a1-4b01-aee2-59bef6708eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-10311cae-8e40-4334-862e-082899231c7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:02.684757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:02.686448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:02.688001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 208/410] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:02.692200 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2067133-95a1-4b01-aee2-59bef6708eec None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:02.692998 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2067133-95a1-4b01-aee2-59bef6708eec None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:02.693764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2067133-95a1-4b01-aee2-59bef6708eec None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/groups/11aa10fe6f70400cac8e79157430350d/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:02.696166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10311cae-8e40-4334-862e-082899231c7f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:02.697796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2067133-95a1-4b01-aee2-59bef6708eec None admin] RBAC: Authorizing `identity:create_grant(project_id=2998613f90a9440da9bf8b1b9eedbb96, group_id=11aa10fe6f70400cac8e79157430350d, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:02.700763 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2067133-95a1-4b01-aee2-59bef6708eec None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:02.732376 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 203/411] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 2 08:10:02 2022] PUT /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96/groups/11aa10fe6f70400cac8e79157430350d/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:10:02.778696 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:02.846247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10311cae-8e40-4334-862e-082899231c7f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:02.855832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178008f-04b8-4e26-9293-2555d51d0395 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:02.856129 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178008f-04b8-4e26-9293-2555d51d0395 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:02.856409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178008f-04b8-4e26-9293-2555d51d0395 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:02.859486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 204/412] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:10:02.864512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f531ac-2ed0-4046-a47f-68367d4f8838 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:02.864799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f531ac-2ed0-4046-a47f-68367d4f8838 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:02.865083 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f531ac-2ed0-4046-a47f-68367d4f8838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:02.886767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-e4f531ac-2ed0-4046-a47f-68367d4f8838 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:02.888356 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e4f531ac-2ed0-4046-a47f-68367d4f8838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:02.905933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cac78-9f42-40e1-b2d5-32c9c72a34b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:02.907228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cac78-9f42-40e1-b2d5-32c9c72a34b3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:02.907689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cac78-9f42-40e1-b2d5-32c9c72a34b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:02.908148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cac78-9f42-40e1-b2d5-32c9c72a34b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:02.909054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cac78-9f42-40e1-b2d5-32c9c72a34b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:02.909691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cac78-9f42-40e1-b2d5-32c9c72a34b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:02.911405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cac78-9f42-40e1-b2d5-32c9c72a34b3 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:02.927630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 209/413] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:02.934672 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cac78-9f42-40e1-b2d5-32c9c72a34b3 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:02.988912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 205/414] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:10:03.036859 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f531ac-2ed0-4046-a47f-68367d4f8838 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:03.052481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cac78-9f42-40e1-b2d5-32c9c72a34b3 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:03.056403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:03.094333 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e31e7-d85d-456a-bdb1-61b2fdc7b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:03.095303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e31e7-d85d-456a-bdb1-61b2fdc7b885 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:03.095788 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e31e7-d85d-456a-bdb1-61b2fdc7b885 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:03.096203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e31e7-d85d-456a-bdb1-61b2fdc7b885 None admin] PATH_INFO: `/v3/groups/43e0589a2ca94ffcbc1facea8b9a3605` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:03.097547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e31e7-d85d-456a-bdb1-61b2fdc7b885 None admin] RBAC: Authorizing `identity:get_group(group_id=43e0589a2ca94ffcbc1facea8b9a3605)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:03.099274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e31e7-d85d-456a-bdb1-61b2fdc7b885 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:03.101427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 210/415] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:10:02 2022] GET /identity/v3/groups/43e0589a2ca94ffcbc1facea8b9a3605 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:03.106871 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e31e7-d85d-456a-bdb1-61b2fdc7b885 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:03.202729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:03.280201 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f531ac-2ed0-4046-a47f-68367d4f8838 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:03.303517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e31e7-d85d-456a-bdb1-61b2fdc7b885 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:03.332767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b749780-a3e7-4d2a-b169-51c1ebfa3961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:03.334338 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749780-a3e7-4d2a-b169-51c1ebfa3961 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:03.335269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749780-a3e7-4d2a-b169-51c1ebfa3961 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:03.335751 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749780-a3e7-4d2a-b169-51c1ebfa3961 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:03.339025 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff061d-2ea5-44e1-8774-35a672c0ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:03.339672 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff061d-2ea5-44e1-8774-35a672c0ec15 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:03.339949 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff061d-2ea5-44e1-8774-35a672c0ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:03.340283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff061d-2ea5-44e1-8774-35a672c0ec15 None admin] PATH_INFO: `/v3/projects/255cf96e6d4c4f0180d3f193cc9e8b40` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:03.341630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff061d-2ea5-44e1-8774-35a672c0ec15 None admin] RBAC: Authorizing `identity:get_project(project_id=255cf96e6d4c4f0180d3f193cc9e8b40)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:03.343120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff061d-2ea5-44e1-8774-35a672c0ec15 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:03.345630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 211/416] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:10:03 2022] GET /identity/v3/projects/255cf96e6d4c4f0180d3f193cc9e8b40 => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:03.351048 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258400e-33c5-4443-8d46-f9bf305e713d None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:03.351332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258400e-33c5-4443-8d46-f9bf305e713d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:03.351611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258400e-33c5-4443-8d46-f9bf305e713d None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:03.352904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 212/417] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:03.359935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258400e-33c5-4443-8d46-f9bf305e713d None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:03.365417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b749780-a3e7-4d2a-b169-51c1ebfa3961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-3b749780-a3e7-4d2a-b169-51c1ebfa3961 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:03.370979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:03.373873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 206/418] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:03.374715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673dedb-e032-4fcc-80db-84a3977dd0d3 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:03.375440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673dedb-e032-4fcc-80db-84a3977dd0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:03.375440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673dedb-e032-4fcc-80db-84a3977dd0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:03.404732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-b673dedb-e032-4fcc-80db-84a3977dd0d3 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:03.406978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b673dedb-e032-4fcc-80db-84a3977dd0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:03.418849 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:03.481127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258400e-33c5-4443-8d46-f9bf305e713d None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:03.490345 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 207/419] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:03.491635 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673dedb-e032-4fcc-80db-84a3977dd0d3 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:03.515885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b282ba8-c578-44b5-aa52-4b97ba33dead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:03.516575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b282ba8-c578-44b5-aa52-4b97ba33dead None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:03.516826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b282ba8-c578-44b5-aa52-4b97ba33dead None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:03.517101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b282ba8-c578-44b5-aa52-4b97ba33dead None admin] PATH_INFO: `/v3/projects/255cf96e6d4c4f0180d3f193cc9e8b40/groups/43e0589a2ca94ffcbc1facea8b9a3605/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:03.519072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b282ba8-c578-44b5-aa52-4b97ba33dead None admin] RBAC: Authorizing `identity:create_grant(project_id=255cf96e6d4c4f0180d3f193cc9e8b40, group_id=43e0589a2ca94ffcbc1facea8b9a3605, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:03.520486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b282ba8-c578-44b5-aa52-4b97ba33dead None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:03.539924 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 213/420] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 2 08:10:03 2022] PUT /identity/v3/projects/255cf96e6d4c4f0180d3f193cc9e8b40/groups/43e0589a2ca94ffcbc1facea8b9a3605/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:10:03.541889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b282ba8-c578-44b5-aa52-4b97ba33dead None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:03.578374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:03.627848 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673dedb-e032-4fcc-80db-84a3977dd0d3 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:03.667760 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3b0b6-1977-4844-83d1-0e5b59f6e002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:03.669141 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3b0b6-1977-4844-83d1-0e5b59f6e002 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:03.669622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3b0b6-1977-4844-83d1-0e5b59f6e002 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:03.670187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3b0b6-1977-4844-83d1-0e5b59f6e002 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:03.671136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3b0b6-1977-4844-83d1-0e5b59f6e002 None admin] RBAC: Adding query filter params (name=member) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:03.671686 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3b0b6-1977-4844-83d1-0e5b59f6e002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:03.673334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3b0b6-1977-4844-83d1-0e5b59f6e002 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:03.684464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 208/421] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:10:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:03.696230 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:03.703646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b282ba8-c578-44b5-aa52-4b97ba33dead None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:03.704908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3b0b6-1977-4844-83d1-0e5b59f6e002 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:03.767275 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2cdd0-fa5c-482e-b5b9-97c82d5c70d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:03.768094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2cdd0-fa5c-482e-b5b9-97c82d5c70d0 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:03.768582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2cdd0-fa5c-482e-b5b9-97c82d5c70d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:03.769067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2cdd0-fa5c-482e-b5b9-97c82d5c70d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:03.812898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2cdd0-fa5c-482e-b5b9-97c82d5c70d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-43b2cdd0-fa5c-482e-b5b9-97c82d5c70d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:03.824195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:03.825125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:10:03.825927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:03.826570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 214/422] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:10:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:03.833377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2cdd0-fa5c-482e-b5b9-97c82d5c70d0 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:03.875803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3b0b6-1977-4844-83d1-0e5b59f6e002 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:03.900453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:03.915456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187db92-68dd-4557-afed-a592961eacdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:03.916764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187db92-68dd-4557-afed-a592961eacdf None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:03.916764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187db92-68dd-4557-afed-a592961eacdf None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:03.917201 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187db92-68dd-4557-afed-a592961eacdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:03.957380 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2cdd0-fa5c-482e-b5b9-97c82d5c70d0 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:03.994427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187db92-68dd-4557-afed-a592961eacdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:03.996030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187db92-68dd-4557-afed-a592961eacdf None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:03.998481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467f18c-68de-48be-8973-b337cf41b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:03.999378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f18c-68de-48be-8973-b337cf41b67d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:04.000394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f18c-68de-48be-8973-b337cf41b67d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:04.000922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467f18c-68de-48be-8973-b337cf41b67d None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:04.001859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467f18c-68de-48be-8973-b337cf41b67d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:04.002496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467f18c-68de-48be-8973-b337cf41b67d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:04.004073 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9467f18c-68de-48be-8973-b337cf41b67d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:04.014867 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 215/423] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:04.027145 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467f18c-68de-48be-8973-b337cf41b67d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:04.068791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:04.101676 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 209/424] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:04.127143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187db92-68dd-4557-afed-a592961eacdf None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:04.169017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:04.186086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467f18c-68de-48be-8973-b337cf41b67d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:04.224852 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fbd89-207d-485c-b0b5-88dc48542254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:04.225627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fbd89-207d-485c-b0b5-88dc48542254 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:04.226178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fbd89-207d-485c-b0b5-88dc48542254 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:04.226744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fbd89-207d-485c-b0b5-88dc48542254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:04.309696 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fbd89-207d-485c-b0b5-88dc48542254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:04.311897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fbd89-207d-485c-b0b5-88dc48542254 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:04.344137 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187db92-68dd-4557-afed-a592961eacdf None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:04.350534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:04.449931 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 216/425] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:04.455673 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fbd89-207d-485c-b0b5-88dc48542254 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:04.459449 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e84cb-ede3-446c-82fc-4d07e0923f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:04.460215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e84cb-ede3-446c-82fc-4d07e0923f75 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:04.460497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e84cb-ede3-446c-82fc-4d07e0923f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:04.460773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e84cb-ede3-446c-82fc-4d07e0923f75 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:04.464455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e84cb-ede3-446c-82fc-4d07e0923f75 None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:04.465910 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e84cb-ede3-446c-82fc-4d07e0923f75 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:04.468019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 210/426] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:10:04 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:04.483490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e84cb-ede3-446c-82fc-4d07e0923f75 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:04.613147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fbd89-207d-485c-b0b5-88dc48542254 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:04.640334 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:04.654388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf7510-be62-460d-b3ff-6b998aea9a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:04.655149 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf7510-be62-460d-b3ff-6b998aea9a17 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:04.655436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf7510-be62-460d-b3ff-6b998aea9a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:04.655777 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf7510-be62-460d-b3ff-6b998aea9a17 None admin] PATH_INFO: `/v3/projects/85dec1bdd87547f7b0d6bdc818811672` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:04.658280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf7510-be62-460d-b3ff-6b998aea9a17 None admin] RBAC: Authorizing `identity:get_project(project_id=85dec1bdd87547f7b0d6bdc818811672)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:04.660478 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf7510-be62-460d-b3ff-6b998aea9a17 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:04.661439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:04.665832 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 217/427] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:10:04 2022] GET /identity/v3/projects/85dec1bdd87547f7b0d6bdc818811672 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:04.671482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf7510-be62-460d-b3ff-6b998aea9a17 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:04.694878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e84cb-ede3-446c-82fc-4d07e0923f75 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:04.767242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b3c9f-804c-4990-a24c-743ad0db9929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:04.767985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b3c9f-804c-4990-a24c-743ad0db9929 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:04.768269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b3c9f-804c-4990-a24c-743ad0db9929 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:04.768544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b3c9f-804c-4990-a24c-743ad0db9929 None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:04.772590 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b3c9f-804c-4990-a24c-743ad0db9929 None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:04.774343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b3c9f-804c-4990-a24c-743ad0db9929 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:04.776138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 211/428] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:10:04 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:04.803450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b3c9f-804c-4990-a24c-743ad0db9929 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:04.891812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf7510-be62-460d-b3ff-6b998aea9a17 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:04.970354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53818c32-f383-4bd8-a0c4-6ba0bc8c7479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:04.971078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818c32-f383-4bd8-a0c4-6ba0bc8c7479 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:04.971365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818c32-f383-4bd8-a0c4-6ba0bc8c7479 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:04.971644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818c32-f383-4bd8-a0c4-6ba0bc8c7479 None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:04.974384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53818c32-f383-4bd8-a0c4-6ba0bc8c7479 None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:04.975844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53818c32-f383-4bd8-a0c4-6ba0bc8c7479 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:04.980403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 218/429] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:10:04 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:04.986047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53818c32-f383-4bd8-a0c4-6ba0bc8c7479 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:05.033399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b3c9f-804c-4990-a24c-743ad0db9929 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:05.095923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad03cc3-61ea-4f42-9ded-b8135a8eba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:05.096538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad03cc3-61ea-4f42-9ded-b8135a8eba4b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:05.097026 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad03cc3-61ea-4f42-9ded-b8135a8eba4b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:05.097507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad03cc3-61ea-4f42-9ded-b8135a8eba4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:05.098521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad03cc3-61ea-4f42-9ded-b8135a8eba4b None admin] RBAC: Adding query filter params (group.id=11aa10fe6f70400cac8e79157430350d, role.id=a4aae8b3b8b4486389006b0d25566eb6, scope.project.id=85dec1bdd87547f7b0d6bdc818811672) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:05.099041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad03cc3-61ea-4f42-9ded-b8135a8eba4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:05.100646 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad03cc3-61ea-4f42-9ded-b8135a8eba4b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:05.103061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:05.108214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 212/430] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 08:10:04 2022] GET /identity/v3/role_assignments?group.id=11aa10fe6f70400cac8e79157430350d&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 611 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:05.110240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106db36-5106-4544-b5ef-85d45ddff31f None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:05.110729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106db36-5106-4544-b5ef-85d45ddff31f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:05.111245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106db36-5106-4544-b5ef-85d45ddff31f None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:05.112805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 213/431] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:05.119862 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4fca1-06ed-47f1-bdda-a2418772a9cf None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:05.120465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4fca1-06ed-47f1-bdda-a2418772a9cf None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:05.120930 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4fca1-06ed-47f1-bdda-a2418772a9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:05.142376 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-b7e4fca1-06ed-47f1-bdda-a2418772a9cf None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:05.143986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b7e4fca1-06ed-47f1-bdda-a2418772a9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:05.159537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53818c32-f383-4bd8-a0c4-6ba0bc8c7479 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:05.164076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:05.210144 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b214a-6989-49e3-b518-a84576098786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:05.210883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b214a-6989-49e3-b518-a84576098786 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:05.211170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b214a-6989-49e3-b518-a84576098786 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:05.211445 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b214a-6989-49e3-b518-a84576098786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:05.212446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b214a-6989-49e3-b518-a84576098786 None admin] RBAC: Adding query filter params (group.id=11aa10fe6f70400cac8e79157430350d, role.id=e1f4e92f38534e1d80123b0beaa2be47, scope.project.id=85dec1bdd87547f7b0d6bdc818811672) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:05.212747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b214a-6989-49e3-b518-a84576098786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:05.214371 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b214a-6989-49e3-b518-a84576098786 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:05.228888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 219/432] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 08:10:04 2022] GET /identity/v3/role_assignments?group.id=11aa10fe6f70400cac8e79157430350d&scope.project.id=85dec1bdd87547f7b0d6bdc818811672&role.id=e1f4e92f38534e1d80123b0beaa2be47 => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:05.231038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 214/433] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:10:05.266627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b214a-6989-49e3-b518-a84576098786 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:05.390129 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fbd3-7534-4e44-8896-388024f07c01 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:05.391133 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fbd3-7534-4e44-8896-388024f07c01 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:05.391646 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07fbd3-7534-4e44-8896-388024f07c01 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:05.393534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 215/434] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:05.399026 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32e8a9-b6f8-4ad8-a5e4-26c0ad4bc602 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:05.399606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32e8a9-b6f8-4ad8-a5e4-26c0ad4bc602 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:05.400151 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32e8a9-b6f8-4ad8-a5e4-26c0ad4bc602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:05.424480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b214a-6989-49e3-b518-a84576098786 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:05.426575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-4c32e8a9-b6f8-4ad8-a5e4-26c0ad4bc602 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:05.428028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4c32e8a9-b6f8-4ad8-a5e4-26c0ad4bc602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:05.455694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:05.473908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34afa-376f-4750-90e0-6f255c8e7d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:05.474847 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34afa-376f-4750-90e0-6f255c8e7d7a None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:05.475269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34afa-376f-4750-90e0-6f255c8e7d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:05.475683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34afa-376f-4750-90e0-6f255c8e7d7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:05.487132 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f34afa-376f-4750-90e0-6f255c8e7d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-71f34afa-376f-4750-90e0-6f255c8e7d7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:05.492521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:05.493787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:05.495499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 220/435] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:10:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:05.499500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34afa-376f-4750-90e0-6f255c8e7d7a None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:05.527879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 216/436] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:10:05.552727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32e8a9-b6f8-4ad8-a5e4-26c0ad4bc602 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:05.626594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34afa-376f-4750-90e0-6f255c8e7d7a None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:05.659488 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:05.670734 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a77603-47ba-405b-b04f-1dc5a8be502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:05.671359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77603-47ba-405b-b04f-1dc5a8be502e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:05.672267 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77603-47ba-405b-b04f-1dc5a8be502e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:05.672484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a77603-47ba-405b-b04f-1dc5a8be502e None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:05.673411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a77603-47ba-405b-b04f-1dc5a8be502e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:05.673524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a77603-47ba-405b-b04f-1dc5a8be502e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:05.675044 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a77603-47ba-405b-b04f-1dc5a8be502e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:05.685441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 221/437] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:05.691109 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32e8a9-b6f8-4ad8-a5e4-26c0ad4bc602 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:05.691271 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a77603-47ba-405b-b04f-1dc5a8be502e None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:05.743962 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070716b-00ba-4a46-a720-7c7de8398079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:05.744972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070716b-00ba-4a46-a720-7c7de8398079 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:05.745447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070716b-00ba-4a46-a720-7c7de8398079 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:05.745912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070716b-00ba-4a46-a720-7c7de8398079 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:05.749278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:05.761963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070716b-00ba-4a46-a720-7c7de8398079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-9070716b-00ba-4a46-a720-7c7de8398079 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:05.767576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:05.768511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:05.769327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 217/438] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:05.774399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070716b-00ba-4a46-a720-7c7de8398079 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:05.826443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a77603-47ba-405b-b04f-1dc5a8be502e None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:05.867080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86ee7a-8cf6-41da-bb13-0ebd2ed83a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:05.868072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86ee7a-8cf6-41da-bb13-0ebd2ed83a84 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:05.868560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86ee7a-8cf6-41da-bb13-0ebd2ed83a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:05.868836 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86ee7a-8cf6-41da-bb13-0ebd2ed83a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:05.906328 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070716b-00ba-4a46-a720-7c7de8398079 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:05.956509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1942d23-a584-4124-b284-2ce058a16f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:05.957167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1942d23-a584-4124-b284-2ce058a16f12 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:05.957511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1942d23-a584-4124-b284-2ce058a16f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:05.957852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1942d23-a584-4124-b284-2ce058a16f12 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:05.958747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1942d23-a584-4124-b284-2ce058a16f12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:05.959194 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1942d23-a584-4124-b284-2ce058a16f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:05.960396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1942d23-a584-4124-b284-2ce058a16f12 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:05.968206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86ee7a-8cf6-41da-bb13-0ebd2ed83a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:05.968992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 218/439] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:10:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:05.970189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86ee7a-8cf6-41da-bb13-0ebd2ed83a84 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:05.975754 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1942d23-a584-4124-b284-2ce058a16f12 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:05.980782 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:06.027802 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:06.094376 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 222/440] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:10:06.095636 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ccb6e-bdc1-4aef-bad9-29b9e73c175f None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.095924 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ccb6e-bdc1-4aef-bad9-29b9e73c175f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.096200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ccb6e-bdc1-4aef-bad9-29b9e73c175f None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.097598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 223/441] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:06.102318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ccb6e-bdc1-4aef-bad9-29b9e73c175f None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:06.110289 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1942d23-a584-4124-b284-2ce058a16f12 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:06.144479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fa3a2-66f4-4356-b975-957d43a40a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:06.145100 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa3a2-66f4-4356-b975-957d43a40a09 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.145395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa3a2-66f4-4356-b975-957d43a40a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.145651 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fa3a2-66f4-4356-b975-957d43a40a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.209264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ccb6e-bdc1-4aef-bad9-29b9e73c175f None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:06.211429 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fa3a2-66f4-4356-b975-957d43a40a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:06.212869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fa3a2-66f4-4356-b975-957d43a40a09 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:06.215906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:06.248014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b045f31-1474-40a6-8b5d-1d9e9adc6e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:06.248642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b045f31-1474-40a6-8b5d-1d9e9adc6e86 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.248948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b045f31-1474-40a6-8b5d-1d9e9adc6e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.249220 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b045f31-1474-40a6-8b5d-1d9e9adc6e86 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.250404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b045f31-1474-40a6-8b5d-1d9e9adc6e86 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:06.251827 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b045f31-1474-40a6-8b5d-1d9e9adc6e86 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:06.253607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 224/442] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:10:06 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:06.254589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af750b-24d8-4abe-9580-2129c34c9c11 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.254999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af750b-24d8-4abe-9580-2129c34c9c11 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.255133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af750b-24d8-4abe-9580-2129c34c9c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.272121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-e5af750b-24d8-4abe-9580-2129c34c9c11 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:06.273303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e5af750b-24d8-4abe-9580-2129c34c9c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:06.280493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:06.312465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 219/443] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:10:06.313360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fa3a2-66f4-4356-b975-957d43a40a09 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:06.349084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 225/444] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:06.350356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af750b-24d8-4abe-9580-2129c34c9c11 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:06.419847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fa3a2-66f4-4356-b975-957d43a40a09 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:06.423372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:06.456124 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855c3cf-0c29-4714-be9b-7058d05dfb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:06.456772 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855c3cf-0c29-4714-be9b-7058d05dfb40 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.457055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855c3cf-0c29-4714-be9b-7058d05dfb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.457329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855c3cf-0c29-4714-be9b-7058d05dfb40 None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.458491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855c3cf-0c29-4714-be9b-7058d05dfb40 None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:06.459979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855c3cf-0c29-4714-be9b-7058d05dfb40 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:06.461739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 220/445] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:10:06 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:06.462195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af750b-24d8-4abe-9580-2129c34c9c11 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:06.462320 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855c3cf-0c29-4714-be9b-7058d05dfb40 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:06.500347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363bff6-f128-442f-8f3d-9474329e3533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:06.500998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363bff6-f128-442f-8f3d-9474329e3533 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.501281 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363bff6-f128-442f-8f3d-9474329e3533 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.501560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363bff6-f128-442f-8f3d-9474329e3533 None admin] PATH_INFO: `/v3/projects/2998613f90a9440da9bf8b1b9eedbb96` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.502768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363bff6-f128-442f-8f3d-9474329e3533 None admin] RBAC: Authorizing `identity:get_project(project_id=2998613f90a9440da9bf8b1b9eedbb96)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:06.504471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363bff6-f128-442f-8f3d-9474329e3533 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:06.506719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 226/446] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:10:06 2022] GET /identity/v3/projects/2998613f90a9440da9bf8b1b9eedbb96 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:06.507405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363bff6-f128-442f-8f3d-9474329e3533 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:06.520132 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:06.562989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855c3cf-0c29-4714-be9b-7058d05dfb40 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:06.597545 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ead100-7ea7-4e64-8676-a8a6967a1c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:06.598209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ead100-7ea7-4e64-8676-a8a6967a1c79 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.598490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ead100-7ea7-4e64-8676-a8a6967a1c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.598761 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ead100-7ea7-4e64-8676-a8a6967a1c79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.608673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ead100-7ea7-4e64-8676-a8a6967a1c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:06.610284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363bff6-f128-442f-8f3d-9474329e3533 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-98ead100-7ea7-4e64-8676-a8a6967a1c79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:06.614098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:06.614986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:06.615796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 221/447] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:06.616481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ead100-7ea7-4e64-8676-a8a6967a1c79 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:06.647850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:06.648850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cca8df-d2a1-4b57-bb7d-50b634bfba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:06.649500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cca8df-d2a1-4b57-bb7d-50b634bfba70 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.649810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cca8df-d2a1-4b57-bb7d-50b634bfba70 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.650199 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cca8df-d2a1-4b57-bb7d-50b634bfba70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.650992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cca8df-d2a1-4b57-bb7d-50b634bfba70 None admin] RBAC: Adding query filter params (group.id=11aa10fe6f70400cac8e79157430350d, role.id=e1f4e92f38534e1d80123b0beaa2be47, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:06.651298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cca8df-d2a1-4b57-bb7d-50b634bfba70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:06.652735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cca8df-d2a1-4b57-bb7d-50b634bfba70 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:06.658592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 227/448] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 08:10:06 2022] GET /identity/v3/role_assignments?group.id=11aa10fe6f70400cac8e79157430350d&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=e1f4e92f38534e1d80123b0beaa2be47 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:06.659369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cca8df-d2a1-4b57-bb7d-50b634bfba70 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:06.734991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ead100-7ea7-4e64-8676-a8a6967a1c79 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:06.745466 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:06.773489 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cca8df-d2a1-4b57-bb7d-50b634bfba70 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:06.774738 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ba5d-1647-4e49-afa9-210c5adcf1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:06.775873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ba5d-1647-4e49-afa9-210c5adcf1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.777177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ba5d-1647-4e49-afa9-210c5adcf1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.777466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ba5d-1647-4e49-afa9-210c5adcf1d6 None admin] PATH_INFO: `/v3/groups/11aa10fe6f70400cac8e79157430350d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.778782 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26ba5d-1647-4e49-afa9-210c5adcf1d6 None admin] RBAC: Authorizing `identity:get_group(group_id=11aa10fe6f70400cac8e79157430350d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:06.780296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26ba5d-1647-4e49-afa9-210c5adcf1d6 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:06.787612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 222/449] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:10:06 2022] GET /identity/v3/groups/11aa10fe6f70400cac8e79157430350d => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:06.788641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ba5d-1647-4e49-afa9-210c5adcf1d6 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:06.813482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b98fd3-2f06-4f93-81c7-1bdbdef296bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:06.814283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b98fd3-2f06-4f93-81c7-1bdbdef296bb None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.814523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b98fd3-2f06-4f93-81c7-1bdbdef296bb None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.814832 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b98fd3-2f06-4f93-81c7-1bdbdef296bb None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.815905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b98fd3-2f06-4f93-81c7-1bdbdef296bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:06.815905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b98fd3-2f06-4f93-81c7-1bdbdef296bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:06.817298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b98fd3-2f06-4f93-81c7-1bdbdef296bb None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:06.828480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 228/450] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:06.834545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b98fd3-2f06-4f93-81c7-1bdbdef296bb None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:06.896836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:06.899744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ba5d-1647-4e49-afa9-210c5adcf1d6 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:06.935039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25554965-c2f2-40b0-9bf3-1ada7768b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:06.935661 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25554965-c2f2-40b0-9bf3-1ada7768b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.935942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25554965-c2f2-40b0-9bf3-1ada7768b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.936217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25554965-c2f2-40b0-9bf3-1ada7768b2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.937041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25554965-c2f2-40b0-9bf3-1ada7768b2d8 None admin] RBAC: Adding query filter params (group.id=11aa10fe6f70400cac8e79157430350d, role.id=a4aae8b3b8b4486389006b0d25566eb6, scope.project.id=2998613f90a9440da9bf8b1b9eedbb96) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:06.937379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25554965-c2f2-40b0-9bf3-1ada7768b2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:06.938833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25554965-c2f2-40b0-9bf3-1ada7768b2d8 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:06.941618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b98fd3-2f06-4f93-81c7-1bdbdef296bb None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:06.944640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 223/451] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 08:10:06 2022] GET /identity/v3/role_assignments?group.id=11aa10fe6f70400cac8e79157430350d&scope.project.id=2998613f90a9440da9bf8b1b9eedbb96&role.id=a4aae8b3b8b4486389006b0d25566eb6 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:06.977215 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b76f13-2f63-4286-8d3e-2e296ccf53a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:06.977847 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b76f13-2f63-4286-8d3e-2e296ccf53a0 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:06.978166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b76f13-2f63-4286-8d3e-2e296ccf53a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:06.978446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b76f13-2f63-4286-8d3e-2e296ccf53a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:06.982407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:07.051813 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b76f13-2f63-4286-8d3e-2e296ccf53a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:07.053207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b76f13-2f63-4286-8d3e-2e296ccf53a0 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:07.153283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 229/452] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 08:10:07.159539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25554965-c2f2-40b0-9bf3-1ada7768b2d8 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:07.270766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25554965-c2f2-40b0-9bf3-1ada7768b2d8 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:07.305939 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e700824-296c-432a-be39-631b9e1ce786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:07.306539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e700824-296c-432a-be39-631b9e1ce786 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:07.306819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e700824-296c-432a-be39-631b9e1ce786 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:07.307092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e700824-296c-432a-be39-631b9e1ce786 None admin] PATH_INFO: `/v3/projects/255cf96e6d4c4f0180d3f193cc9e8b40` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:07.308238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e700824-296c-432a-be39-631b9e1ce786 None admin] RBAC: Authorizing `identity:get_project(project_id=255cf96e6d4c4f0180d3f193cc9e8b40)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:07.309663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e700824-296c-432a-be39-631b9e1ce786 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:07.311340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 224/453] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:10:07 2022] GET /identity/v3/projects/255cf96e6d4c4f0180d3f193cc9e8b40 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:07.319215 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b76f13-2f63-4286-8d3e-2e296ccf53a0 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:07.355452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:07.424052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b76f13-2f63-4286-8d3e-2e296ccf53a0 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:07.456932 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ed6fc-0bd9-4602-a735-ed81531b63a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:07.457560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ed6fc-0bd9-4602-a735-ed81531b63a7 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:07.457837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ed6fc-0bd9-4602-a735-ed81531b63a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:07.458136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ed6fc-0bd9-4602-a735-ed81531b63a7 None admin] PATH_INFO: `/v3/groups/43e0589a2ca94ffcbc1facea8b9a3605` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:07.459262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ed6fc-0bd9-4602-a735-ed81531b63a7 None admin] RBAC: Authorizing `identity:get_group(group_id=43e0589a2ca94ffcbc1facea8b9a3605)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:07.460688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ed6fc-0bd9-4602-a735-ed81531b63a7 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:07.462286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 230/454] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 08:10:07 2022] GET /identity/v3/groups/43e0589a2ca94ffcbc1facea8b9a3605 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:07.468071 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e700824-296c-432a-be39-631b9e1ce786 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:07.498596 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:07.564855 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e700824-296c-432a-be39-631b9e1ce786 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:07.597173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b69ea-dafd-4af5-8672-783a95db878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:07.597778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b69ea-dafd-4af5-8672-783a95db878a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:07.598076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b69ea-dafd-4af5-8672-783a95db878a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:07.598350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b69ea-dafd-4af5-8672-783a95db878a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:07.599132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b69ea-dafd-4af5-8672-783a95db878a None admin] RBAC: Adding query filter params (group.id=43e0589a2ca94ffcbc1facea8b9a3605, role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=255cf96e6d4c4f0180d3f193cc9e8b40) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:07.599439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b69ea-dafd-4af5-8672-783a95db878a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:07.600842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b69ea-dafd-4af5-8672-783a95db878a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:07.606476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 225/455] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 08:10:07 2022] GET /identity/v3/role_assignments?group.id=43e0589a2ca94ffcbc1facea8b9a3605&scope.project.id=255cf96e6d4c4f0180d3f193cc9e8b40&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:10.429209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5c795-28df-412d-9686-8e0da1b8edd7 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:10.430196 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5c795-28df-412d-9686-8e0da1b8edd7 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:10.430676 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5c795-28df-412d-9686-8e0da1b8edd7 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:10.432532 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 231/456] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:10.438146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b823cd9-60af-4c5e-ab45-278cac0efc2a None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:10.438994 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b823cd9-60af-4c5e-ab45-278cac0efc2a None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:10.439469 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b823cd9-60af-4c5e-ab45-278cac0efc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:10.467032 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-8b823cd9-60af-4c5e-ab45-278cac0efc2a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:10.468612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8b823cd9-60af-4c5e-ab45-278cac0efc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:10.522043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4bb3-702e-46e1-aa9b-03fad33a6feb None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:10.522043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4bb3-702e-46e1-aa9b-03fad33a6feb None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:10.522043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a4bb3-702e-46e1-aa9b-03fad33a6feb None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:10.523402 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 232/457] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:10.537105 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e88db-db79-4079-b364-f42cb8ddf2b4 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:10.537725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e88db-db79-4079-b364-f42cb8ddf2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:10.538260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e88db-db79-4079-b364-f42cb8ddf2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:10.567496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 226/458] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:10.579037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-8b4e88db-db79-4079-b364-f42cb8ddf2b4 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:10.580534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-8b4e88db-db79-4079-b364-f42cb8ddf2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:10.593067 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b823cd9-60af-4c5e-ab45-278cac0efc2a None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:10.627368 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:10.701646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 233/459] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:10:10.701646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2a64-a0d3-4a8c-928f-3eea82707d8e None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:10.701646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2a64-a0d3-4a8c-928f-3eea82707d8e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:10.701646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e2a64-a0d3-4a8c-928f-3eea82707d8e None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:10.701646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 234/460] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:10.708590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4075759-acc3-42cb-90e2-40336f1386bb None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:10.708875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4075759-acc3-42cb-90e2-40336f1386bb None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:10.709152 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4075759-acc3-42cb-90e2-40336f1386bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:10.744263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b823cd9-60af-4c5e-ab45-278cac0efc2a None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:10.744994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-a4075759-acc3-42cb-90e2-40336f1386bb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:10.747658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-a4075759-acc3-42cb-90e2-40336f1386bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:10.790377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:10.793898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24c43b-18a5-49cb-8e3b-fabf365689eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:10.794670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c43b-18a5-49cb-8e3b-fabf365689eb None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:10.794900 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c43b-18a5-49cb-8e3b-fabf365689eb None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:10.795139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24c43b-18a5-49cb-8e3b-fabf365689eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:10.813972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24c43b-18a5-49cb-8e3b-fabf365689eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:10.813972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24c43b-18a5-49cb-8e3b-fabf365689eb None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-9d24c43b-18a5-49cb-8e3b-fabf365689eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:10.829233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:10.830351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:10.831603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:10.831603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:10.831603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:10.831603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:10.831603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 227/461] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:10.831603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24c43b-18a5-49cb-8e3b-fabf365689eb None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:10.858409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 235/462] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:10.860499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4075759-acc3-42cb-90e2-40336f1386bb None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:10.943900 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:10.971382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24c43b-18a5-49cb-8e3b-fabf365689eb None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:11.009970 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4075759-acc3-42cb-90e2-40336f1386bb None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:11.012463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75960a9-a974-4456-a178-ada4dba3a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:11.013401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75960a9-a974-4456-a178-ada4dba3a891 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.013925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75960a9-a974-4456-a178-ada4dba3a891 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.014493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75960a9-a974-4456-a178-ada4dba3a891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.027328 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75960a9-a974-4456-a178-ada4dba3a891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:11.029177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75960a9-a974-4456-a178-ada4dba3a891 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-a75960a9-a974-4456-a178-ada4dba3a891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:11.049828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:11.050944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:11.052155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:11.052155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:11.052155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:11.052155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:11.052417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc94b2-abde-4eb0-ad66-7b1c2fdd3862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:11.052873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc94b2-abde-4eb0-ad66-7b1c2fdd3862 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.053265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc94b2-abde-4eb0-ad66-7b1c2fdd3862 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.053765 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc94b2-abde-4eb0-ad66-7b1c2fdd3862 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.054741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc94b2-abde-4eb0-ad66-7b1c2fdd3862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:11.055254 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc94b2-abde-4eb0-ad66-7b1c2fdd3862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:11.060566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc94b2-abde-4eb0-ad66-7b1c2fdd3862 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:11.060913 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 228/463] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:11.062123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75960a9-a974-4456-a178-ada4dba3a891 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:11.078382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 236/464] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:11.084050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc94b2-abde-4eb0-ad66-7b1c2fdd3862 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:11.116251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:11.180468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75960a9-a974-4456-a178-ada4dba3a891 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:11.203532 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc94b2-abde-4eb0-ad66-7b1c2fdd3862 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:11.216139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:11.224156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace1bb7-93c7-4906-b6c0-d90da825d980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:11.225093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace1bb7-93c7-4906-b6c0-d90da825d980 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.225522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace1bb7-93c7-4906-b6c0-d90da825d980 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.226071 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace1bb7-93c7-4906-b6c0-d90da825d980 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.238893 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace1bb7-93c7-4906-b6c0-d90da825d980 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:11.240693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace1bb7-93c7-4906-b6c0-d90da825d980 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:11.246898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5b673-9dfe-452f-8a34-694ae2bad152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:11.247708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5b673-9dfe-452f-8a34-694ae2bad152 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.248085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5b673-9dfe-452f-8a34-694ae2bad152 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.248866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5b673-9dfe-452f-8a34-694ae2bad152 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.249422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5b673-9dfe-452f-8a34-694ae2bad152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:11.249968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5b673-9dfe-452f-8a34-694ae2bad152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:11.251574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5b673-9dfe-452f-8a34-694ae2bad152 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-5ace1bb7-93c7-4906-b6c0-d90da825d980 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:11.258105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:11.258987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:11.259830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:11.259830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:11.259830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:11.259830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:11.262356 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 229/465] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:11.263396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace1bb7-93c7-4906-b6c0-d90da825d980 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:11.277756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 237/466] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:11.277756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5b673-9dfe-452f-8a34-694ae2bad152 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:11.387205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:11.398581 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace1bb7-93c7-4906-b6c0-d90da825d980 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:11.409379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5b673-9dfe-452f-8a34-694ae2bad152 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:11.434264 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacd749-dfae-400b-9622-8ea151795c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:11.434894 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacd749-dfae-400b-9622-8ea151795c17 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.435175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacd749-dfae-400b-9622-8ea151795c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.435448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacd749-dfae-400b-9622-8ea151795c17 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.436135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacd749-dfae-400b-9622-8ea151795c17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:11.438167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacd749-dfae-400b-9622-8ea151795c17 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:11.448582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974a761-2dfc-4ea9-a2d0-4c3a469bd7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:11.449204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974a761-2dfc-4ea9-a2d0-4c3a469bd7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.449481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974a761-2dfc-4ea9-a2d0-4c3a469bd7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.449972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974a761-2dfc-4ea9-a2d0-4c3a469bd7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.451091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974a761-2dfc-4ea9-a2d0-4c3a469bd7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:11.451595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974a761-2dfc-4ea9-a2d0-4c3a469bd7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:11.453756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974a761-2dfc-4ea9-a2d0-4c3a469bd7e9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:11.463069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 230/467] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:10:11 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:10:11.464112 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacd749-dfae-400b-9622-8ea151795c17 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:11.478843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 238/468] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:11.480489 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031b62-e769-42a1-8e95-745a4823945a None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.480935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031b62-e769-42a1-8e95-745a4823945a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.481383 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd031b62-e769-42a1-8e95-745a4823945a None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.487624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 239/469] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:11.488604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd031b62-e769-42a1-8e95-745a4823945a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:11.539168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:11.626062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd031b62-e769-42a1-8e95-745a4823945a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:11.632730 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacd749-dfae-400b-9622-8ea151795c17 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:11.677117 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ce727-8584-4788-8cd0-23b53f650673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:11.677819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce727-8584-4788-8cd0-23b53f650673 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.678711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce727-8584-4788-8cd0-23b53f650673 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.678711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ce727-8584-4788-8cd0-23b53f650673 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.679097 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce727-8584-4788-8cd0-23b53f650673 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:11.680859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed6dd6-b634-4be8-9040-86d389c25186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:11.680859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6dd6-b634-4be8-9040-86d389c25186 None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.681050 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ce727-8584-4788-8cd0-23b53f650673 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:11.681120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6dd6-b634-4be8-9040-86d389c25186 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.681120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6dd6-b634-4be8-9040-86d389c25186 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.681819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6dd6-b634-4be8-9040-86d389c25186 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:11.683414 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6dd6-b634-4be8-9040-86d389c25186 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:11.707375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:11.711088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 231/470] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:10:11 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:10:11.712589 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d509b-41cc-4990-b05a-2fd89b18f343 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.713050 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d509b-41cc-4990-b05a-2fd89b18f343 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.713476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d509b-41cc-4990-b05a-2fd89b18f343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.713954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 240/471] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:10:11 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:10:11.742185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-109d509b-41cc-4990-b05a-2fd89b18f343 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:11.743988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-109d509b-41cc-4990-b05a-2fd89b18f343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:11.812602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c2e05-89e1-41c0-b109-8d1c41a57b3d None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.812973 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c2e05-89e1-41c0-b109-8d1c41a57b3d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.813171 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c2e05-89e1-41c0-b109-8d1c41a57b3d None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.815820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 241/472] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:10:11.820426 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135829c-7e77-4b15-a779-a3f3caa5d2e7 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:11.821088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135829c-7e77-4b15-a779-a3f3caa5d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:11.821577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135829c-7e77-4b15-a779-a3f3caa5d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:11.859080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-7135829c-7e77-4b15-a779-a3f3caa5d2e7 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:11.860997 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7135829c-7e77-4b15-a779-a3f3caa5d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:11.864968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 232/473] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:11.916673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d509b-41cc-4990-b05a-2fd89b18f343 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:11.951115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:11.958240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 242/474] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:10:11.986384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135829c-7e77-4b15-a779-a3f3caa5d2e7 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:12.045893 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d509b-41cc-4990-b05a-2fd89b18f343 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:12.095958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691869ce-1a09-49c4-b8b6-ad4badc633c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:12.096947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691869ce-1a09-49c4-b8b6-ad4badc633c8 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:12.097407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691869ce-1a09-49c4-b8b6-ad4badc633c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:12.097857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691869ce-1a09-49c4-b8b6-ad4badc633c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:12.114237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691869ce-1a09-49c4-b8b6-ad4badc633c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:12.116489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691869ce-1a09-49c4-b8b6-ad4badc633c8 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:12.120436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135829c-7e77-4b15-a779-a3f3caa5d2e7 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-691869ce-1a09-49c4-b8b6-ad4badc633c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:12.137985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:12.138935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:12.139805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:12.139805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:12.139805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:12.139805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:12.142578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 233/475] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:12.148607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691869ce-1a09-49c4-b8b6-ad4badc633c8 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:12.158064 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:12.179178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb5a56-481a-45d2-820c-ca1f80444260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:12.179925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5a56-481a-45d2-820c-ca1f80444260 None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:12.180151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5a56-481a-45d2-820c-ca1f80444260 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:12.180435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb5a56-481a-45d2-820c-ca1f80444260 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:12.181165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb5a56-481a-45d2-820c-ca1f80444260 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:12.182796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb5a56-481a-45d2-820c-ca1f80444260 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:12.199409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.sql.core [None req-6fdb5a56-481a-45d2-820c-ca1f80444260 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 08:10:12.199409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 08:10:12.199409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [parameters: {'id': '2e2c02d6378544468d408300266ca8be', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 08:10:12.199409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80184) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-6fdb5a56-481a-45d2-820c-ca1f80444260 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application result.read() Aug 02 08:10:12.221258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return ref.to_dict() Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:10:12.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application yield resource Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise self.value Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application session.commit() Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 08:10:12.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self.session.flush() Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application compat.raise_( Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 08:10:12.224577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:10:12.225471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application result.read() Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:10:12.226337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [parameters: {'id': '2e2c02d6378544468d408300266ca8be', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:12.227123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 08:10:12.228020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:12.228870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 243/476] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 2 08:10:11 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:12.228870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb5a56-481a-45d2-820c-ca1f80444260 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:12.261257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:12.308344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691869ce-1a09-49c4-b8b6-ad4badc633c8 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:12.366222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e14642-9a0d-4501-a9dc-abced28d1cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:12.366993 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e14642-9a0d-4501-a9dc-abced28d1cec None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:12.367283 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e14642-9a0d-4501-a9dc-abced28d1cec None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:12.367571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e14642-9a0d-4501-a9dc-abced28d1cec None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:12.368494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e14642-9a0d-4501-a9dc-abced28d1cec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:12.368811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e14642-9a0d-4501-a9dc-abced28d1cec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:12.370477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e14642-9a0d-4501-a9dc-abced28d1cec None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:12.385189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 234/477] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:12.390394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e14642-9a0d-4501-a9dc-abced28d1cec None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:12.429056 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb5a56-481a-45d2-820c-ca1f80444260 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:12.479474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cd4f7-0f5a-48c3-8d87-c4497277c9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:12.480107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cd4f7-0f5a-48c3-8d87-c4497277c9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:12.480343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cd4f7-0f5a-48c3-8d87-c4497277c9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:12.480587 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cd4f7-0f5a-48c3-8d87-c4497277c9e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:12.499302 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cd4f7-0f5a-48c3-8d87-c4497277c9e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-8e5cd4f7-0f5a-48c3-8d87-c4497277c9e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:12.504695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:12.505697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 08:10:12.506604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:12.510130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 244/478] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:10:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:12.512464 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cd4f7-0f5a-48c3-8d87-c4497277c9e1 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:12.574568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:12.588146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e14642-9a0d-4501-a9dc-abced28d1cec None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:12.628915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cd4f7-0f5a-48c3-8d87-c4497277c9e1 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:12.646034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fee07-e824-4760-8a4d-2c766dccc5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:12.646667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fee07-e824-4760-8a4d-2c766dccc5fa None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:12.647047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fee07-e824-4760-8a4d-2c766dccc5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:12.647330 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fee07-e824-4760-8a4d-2c766dccc5fa None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:12.648112 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fee07-e824-4760-8a4d-2c766dccc5fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:12.654029 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fee07-e824-4760-8a4d-2c766dccc5fa None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:12.660763 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:12.688801 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 235/479] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:10:12 2022] POST /identity/v3/users => generated 249 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:10:12.731033 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f967355-f1e1-4b19-925d-48c367b1472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:12.731684 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f967355-f1e1-4b19-925d-48c367b1472c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:12.732018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f967355-f1e1-4b19-925d-48c367b1472c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:12.732300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f967355-f1e1-4b19-925d-48c367b1472c None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:12.733045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f967355-f1e1-4b19-925d-48c367b1472c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:12.733362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f967355-f1e1-4b19-925d-48c367b1472c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:12.734900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f967355-f1e1-4b19-925d-48c367b1472c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:12.744313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 245/480] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:14.020500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3485-8105-4264-876a-388cc090a492 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:14.021525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3485-8105-4264-876a-388cc090a492 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:14.022051 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e3485-8105-4264-876a-388cc090a492 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:14.023609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 236/481] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:10:14.042133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f38c2-0504-443b-a445-ba62f6be191b None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:14.043529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f38c2-0504-443b-a445-ba62f6be191b None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:14.044270 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f38c2-0504-443b-a445-ba62f6be191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:14.083926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d78f38c2-0504-443b-a445-ba62f6be191b None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:14.086271 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d78f38c2-0504-443b-a445-ba62f6be191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:14.238039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 246/482] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:14.266273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec466a3-7a75-4437-9d41-c2631cb1fec5 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:14.266654 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec466a3-7a75-4437-9d41-c2631cb1fec5 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:14.266889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec466a3-7a75-4437-9d41-c2631cb1fec5 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:14.268398 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 237/483] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:14.273441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d698d9-80ef-4ac1-9031-1c80645024c6 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:14.273687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d698d9-80ef-4ac1-9031-1c80645024c6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:14.273972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d698d9-80ef-4ac1-9031-1c80645024c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:14.277528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f38c2-0504-443b-a445-ba62f6be191b None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:14.294809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-07d698d9-80ef-4ac1-9031-1c80645024c6 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:14.296007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-07d698d9-80ef-4ac1-9031-1c80645024c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:14.370461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:14.434743 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f38c2-0504-443b-a445-ba62f6be191b None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:14.475853 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 238/484] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:14.482800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074cf1a-978f-4847-8e1a-bd4025247be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:14.483761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074cf1a-978f-4847-8e1a-bd4025247be8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:14.484880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074cf1a-978f-4847-8e1a-bd4025247be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:14.485375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074cf1a-978f-4847-8e1a-bd4025247be8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:14.499022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d698d9-80ef-4ac1-9031-1c80645024c6 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:14.510996 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074cf1a-978f-4847-8e1a-bd4025247be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-2074cf1a-978f-4847-8e1a-bd4025247be8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:14.516450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:14.517335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:14.518231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:14.526099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 247/485] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:14.533646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074cf1a-978f-4847-8e1a-bd4025247be8 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:14.608898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d698d9-80ef-4ac1-9031-1c80645024c6 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:14.640990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:14.651161 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e901342-efc4-4f33-a15f-49c3e7ced873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:14.652331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e901342-efc4-4f33-a15f-49c3e7ced873 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:14.652614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e901342-efc4-4f33-a15f-49c3e7ced873 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:14.653163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e901342-efc4-4f33-a15f-49c3e7ced873 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:14.664877 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074cf1a-978f-4847-8e1a-bd4025247be8 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:14.669120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e901342-efc4-4f33-a15f-49c3e7ced873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:14.674543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-3e901342-efc4-4f33-a15f-49c3e7ced873 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:14.674912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:14.675975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:14.676856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:14.681775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 239/486] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:14.683319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c9cc5-8344-4554-82f7-983882bedb09 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:14.683606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c9cc5-8344-4554-82f7-983882bedb09 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:14.683886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c9cc5-8344-4554-82f7-983882bedb09 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:14.689855 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 240/487] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:14.689855 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c9cc5-8344-4554-82f7-983882bedb09 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:14.717356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a102d-c3f3-4aa7-8f30-d58ab016d679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:14.718959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a102d-c3f3-4aa7-8f30-d58ab016d679 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:14.719443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a102d-c3f3-4aa7-8f30-d58ab016d679 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:14.719933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a102d-c3f3-4aa7-8f30-d58ab016d679 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:14.720888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a102d-c3f3-4aa7-8f30-d58ab016d679 None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:14.721384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a102d-c3f3-4aa7-8f30-d58ab016d679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:14.723145 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a102d-c3f3-4aa7-8f30-d58ab016d679 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:14.732449 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 248/488] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:14.734545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954059-7448-4267-887a-e8f9d3bd0aaa None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:14.735009 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954059-7448-4267-887a-e8f9d3bd0aaa None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:14.735475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8954059-7448-4267-887a-e8f9d3bd0aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:14.755402 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-e8954059-7448-4267-887a-e8f9d3bd0aaa None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:14.757068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e8954059-7448-4267-887a-e8f9d3bd0aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:14.807429 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c9cc5-8344-4554-82f7-983882bedb09 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:14.842263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e89fc0-b20a-4b5f-983a-494ec49b4122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:14.842606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 249/489] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:14.842757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e89fc0-b20a-4b5f-983a-494ec49b4122 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:14.843080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e89fc0-b20a-4b5f-983a-494ec49b4122 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:14.843629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e89fc0-b20a-4b5f-983a-494ec49b4122 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:14.844255 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8954059-7448-4267-887a-e8f9d3bd0aaa None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:14.844563 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e89fc0-b20a-4b5f-983a-494ec49b4122 None admin] RBAC: Adding query filter params (name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:14.845080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e89fc0-b20a-4b5f-983a-494ec49b4122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:14.846603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e89fc0-b20a-4b5f-983a-494ec49b4122 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:14.858108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 241/490] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:14.861665 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e89fc0-b20a-4b5f-983a-494ec49b4122 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:14.910196 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:14.970787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e89fc0-b20a-4b5f-983a-494ec49b4122 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:14.974411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:14.978953 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8954059-7448-4267-887a-e8f9d3bd0aaa None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:15.006746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1549e-b9a7-4eef-8367-91b3c31f3412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:15.007396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1549e-b9a7-4eef-8367-91b3c31f3412 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.007679 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1549e-b9a7-4eef-8367-91b3c31f3412 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.008003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1549e-b9a7-4eef-8367-91b3c31f3412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.018511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b459c7-b72e-41ab-b240-cf300e00f998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:15.019161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b459c7-b72e-41ab-b240-cf300e00f998 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.019507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b459c7-b72e-41ab-b240-cf300e00f998 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.019783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b459c7-b72e-41ab-b240-cf300e00f998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.019963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1549e-b9a7-4eef-8367-91b3c31f3412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:15.021445 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1549e-b9a7-4eef-8367-91b3c31f3412 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:15.031946 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b459c7-b72e-41ab-b240-cf300e00f998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:15.033395 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b459c7-b72e-41ab-b240-cf300e00f998 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-73c1549e-b9a7-4eef-8367-91b3c31f3412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:15.036972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:15.037838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:15.038778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:15.038778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:15.038778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:15.038778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:15.038778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 242/491] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:15.039049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1549e-b9a7-4eef-8367-91b3c31f3412 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-23b459c7-b72e-41ab-b240-cf300e00f998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:15.050598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:15.052986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:15.055100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:15.055100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:15.055100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:15.055100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:15.055100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 250/492] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:15.055100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b459c7-b72e-41ab-b240-cf300e00f998 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:15.144189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:15.150826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1549e-b9a7-4eef-8367-91b3c31f3412 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:15.176728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b459c7-b72e-41ab-b240-cf300e00f998 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:15.187676 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e44c7-2c58-4750-8a49-cedc9a0c79ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:15.188330 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e44c7-2c58-4750-8a49-cedc9a0c79ee None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.188618 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e44c7-2c58-4750-8a49-cedc9a0c79ee None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.188895 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e44c7-2c58-4750-8a49-cedc9a0c79ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.200774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e44c7-2c58-4750-8a49-cedc9a0c79ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-958e44c7-2c58-4750-8a49-cedc9a0c79ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:15.206964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:15.209193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:15.211163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:15.218044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 243/493] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:15.218044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e44c7-2c58-4750-8a49-cedc9a0c79ee None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:15.218296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb4eaa-a1af-44ae-9006-3f8989e0e8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:15.218296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb4eaa-a1af-44ae-9006-3f8989e0e8be None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.218296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb4eaa-a1af-44ae-9006-3f8989e0e8be None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.218296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb4eaa-a1af-44ae-9006-3f8989e0e8be None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.219190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb4eaa-a1af-44ae-9006-3f8989e0e8be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:15.219589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb4eaa-a1af-44ae-9006-3f8989e0e8be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:15.221067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb4eaa-a1af-44ae-9006-3f8989e0e8be None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:15.235952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 251/494] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:15.236935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb4eaa-a1af-44ae-9006-3f8989e0e8be None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:15.259866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:15.367487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e44c7-2c58-4750-8a49-cedc9a0c79ee None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:15.390572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb4eaa-a1af-44ae-9006-3f8989e0e8be None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:15.404907 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3234d-ef4e-40e3-8c3c-30bcea1f65ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:15.405452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3234d-ef4e-40e3-8c3c-30bcea1f65ae None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.406316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3234d-ef4e-40e3-8c3c-30bcea1f65ae None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.406597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3234d-ef4e-40e3-8c3c-30bcea1f65ae None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.407300 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3234d-ef4e-40e3-8c3c-30bcea1f65ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:15.407611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3234d-ef4e-40e3-8c3c-30bcea1f65ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:15.408982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3234d-ef4e-40e3-8c3c-30bcea1f65ae None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:15.428616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 244/495] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:15.428616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3234d-ef4e-40e3-8c3c-30bcea1f65ae None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:15.443992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155083-f855-4030-8022-68454ade00a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:15.445129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155083-f855-4030-8022-68454ade00a9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.445663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155083-f855-4030-8022-68454ade00a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.446343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:15.447602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155083-f855-4030-8022-68454ade00a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.448972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e155083-f855-4030-8022-68454ade00a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:15.449424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e155083-f855-4030-8022-68454ade00a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:15.451875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e155083-f855-4030-8022-68454ade00a9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:15.463325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 252/496] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:15.464382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155083-f855-4030-8022-68454ade00a9 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:15.538861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3234d-ef4e-40e3-8c3c-30bcea1f65ae None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:15.547329 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:15.576065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b62d7-891e-4f6f-950c-0eb92a2b2c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:15.577259 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b62d7-891e-4f6f-950c-0eb92a2b2c69 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.578289 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b62d7-891e-4f6f-950c-0eb92a2b2c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.578749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b62d7-891e-4f6f-950c-0eb92a2b2c69 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.583827 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155083-f855-4030-8022-68454ade00a9 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:15.591643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b62d7-891e-4f6f-950c-0eb92a2b2c69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:15.594591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b62d7-891e-4f6f-950c-0eb92a2b2c69 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-939b62d7-891e-4f6f-950c-0eb92a2b2c69 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:15.610929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:15.612139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:15.613209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:15.613209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:15.613209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:15.613209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:15.613209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:15.613209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:15.613209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:15.613209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:15.613209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:10:15.613209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:15.613209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 245/497] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:15.613783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21728a6-11c7-4ea9-9579-e4d5463f86fb None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.613848 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21728a6-11c7-4ea9-9579-e4d5463f86fb None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.614151 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21728a6-11c7-4ea9-9579-e4d5463f86fb None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.618137 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 246/498] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:15.618137 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21728a6-11c7-4ea9-9579-e4d5463f86fb None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:15.631423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d066dc-e32b-4365-94e8-3515dd364786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:15.632069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d066dc-e32b-4365-94e8-3515dd364786 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.632375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d066dc-e32b-4365-94e8-3515dd364786 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.632621 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d066dc-e32b-4365-94e8-3515dd364786 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.641729 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d066dc-e32b-4365-94e8-3515dd364786 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:15.643217 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d066dc-e32b-4365-94e8-3515dd364786 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-32d066dc-e32b-4365-94e8-3515dd364786 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:15.656659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:15.657674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:15.658628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:15.658628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:15.658628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:15.658628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:15.658628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:15.658628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:15.658628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:15.658628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:15.658628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:15.658628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:15.662534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 253/499] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 08:10:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:15.663467 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d066dc-e32b-4365-94e8-3515dd364786 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:15.707889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:15.735048 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21728a6-11c7-4ea9-9579-e4d5463f86fb None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:15.767885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d066dc-e32b-4365-94e8-3515dd364786 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:15.772300 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1eed3-4c4e-4ef4-af53-b89991a0e68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:15.772927 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1eed3-4c4e-4ef4-af53-b89991a0e68c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.773244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1eed3-4c4e-4ef4-af53-b89991a0e68c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.773465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1eed3-4c4e-4ef4-af53-b89991a0e68c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.788470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1eed3-4c4e-4ef4-af53-b89991a0e68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:15.789945 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1eed3-4c4e-4ef4-af53-b89991a0e68c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:15.800162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-32f1eed3-4c4e-4ef4-af53-b89991a0e68c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:15.804887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:15.806753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:15.808407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:15.808407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:15.808407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:15.808407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:15.808407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 247/500] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:15.808829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d585f-e083-40fd-a58f-eac72ce971c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:15.808971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65dd01-aab3-42c6-b8ce-a7cbcbc6a00e None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.809078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d585f-e083-40fd-a58f-eac72ce971c5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.809182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65dd01-aab3-42c6-b8ce-a7cbcbc6a00e None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.809283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d585f-e083-40fd-a58f-eac72ce971c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.809395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65dd01-aab3-42c6-b8ce-a7cbcbc6a00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.809605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d585f-e083-40fd-a58f-eac72ce971c5 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.809605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d585f-e083-40fd-a58f-eac72ce971c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:15.809605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d585f-e083-40fd-a58f-eac72ce971c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:15.810998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d585f-e083-40fd-a58f-eac72ce971c5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:15.826332 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-5c65dd01-aab3-42c6-b8ce-a7cbcbc6a00e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:15.828077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-5c65dd01-aab3-42c6-b8ce-a7cbcbc6a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:15.848645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 254/501] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 08:10:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:15.849905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9f8d5-ae10-4bd7-bf44-a8a4e0df1831 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:15.850231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9f8d5-ae10-4bd7-bf44-a8a4e0df1831 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:15.850507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9f8d5-ae10-4bd7-bf44-a8a4e0df1831 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:15.854055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 255/502] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:15.854055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9f8d5-ae10-4bd7-bf44-a8a4e0df1831 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:15.905716 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 248/503] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:15.907248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65dd01-aab3-42c6-b8ce-a7cbcbc6a00e None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:15.970135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:15.974542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9f8d5-ae10-4bd7-bf44-a8a4e0df1831 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:16.013790 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1f5ac-5017-46b9-8b1c-eb9fdbcdac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:16.014572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f5ac-5017-46b9-8b1c-eb9fdbcdac59 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:16.015010 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f5ac-5017-46b9-8b1c-eb9fdbcdac59 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:16.015863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f5ac-5017-46b9-8b1c-eb9fdbcdac59 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:16.016878 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1f5ac-5017-46b9-8b1c-eb9fdbcdac59 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:16.017277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1f5ac-5017-46b9-8b1c-eb9fdbcdac59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:16.018971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1f5ac-5017-46b9-8b1c-eb9fdbcdac59 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:16.019978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65dd01-aab3-42c6-b8ce-a7cbcbc6a00e None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:16.039728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 256/504] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 08:10:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:16.040678 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1f5ac-5017-46b9-8b1c-eb9fdbcdac59 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:16.068878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9232635-1ddb-4fab-93f7-970233804ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:16.069852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232635-1ddb-4fab-93f7-970233804ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:16.070286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232635-1ddb-4fab-93f7-970233804ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:16.070715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232635-1ddb-4fab-93f7-970233804ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:16.071802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9232635-1ddb-4fab-93f7-970233804ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:16.072284 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9232635-1ddb-4fab-93f7-970233804ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:16.074725 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9232635-1ddb-4fab-93f7-970233804ab9 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:16.092677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 249/505] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:16.094278 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d170e-b926-429c-a8ac-769f5727afa9 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:16.094492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d170e-b926-429c-a8ac-769f5727afa9 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:16.094781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d170e-b926-429c-a8ac-769f5727afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:16.106719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:16.113817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-929d170e-b926-429c-a8ac-769f5727afa9 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:16.115049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-929d170e-b926-429c-a8ac-769f5727afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:16.165687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1f5ac-5017-46b9-8b1c-eb9fdbcdac59 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:16.202054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 250/506] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:16.202054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d170e-b926-429c-a8ac-769f5727afa9 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:16.223850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2675a76-81da-4fe3-bbd3-a503d0ff5487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:16.224486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2675a76-81da-4fe3-bbd3-a503d0ff5487 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:16.224768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2675a76-81da-4fe3-bbd3-a503d0ff5487 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:16.225290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2675a76-81da-4fe3-bbd3-a503d0ff5487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:16.253412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:16.299065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2675a76-81da-4fe3-bbd3-a503d0ff5487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:16.300522 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2675a76-81da-4fe3-bbd3-a503d0ff5487 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:16.309808 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d170e-b926-429c-a8ac-769f5727afa9 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:16.346420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a09098-ac02-4e9e-afbc-5d9f4de9c647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:16.347401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a09098-ac02-4e9e-afbc-5d9f4de9c647 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:16.347586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a09098-ac02-4e9e-afbc-5d9f4de9c647 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:16.347733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a09098-ac02-4e9e-afbc-5d9f4de9c647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:16.356432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:16.364466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a09098-ac02-4e9e-afbc-5d9f4de9c647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:16.365942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a09098-ac02-4e9e-afbc-5d9f4de9c647 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-87a09098-ac02-4e9e-afbc-5d9f4de9c647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:16.381903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:16.382899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:16.383755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:16.383755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:16.383755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:16.383755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:16.383755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 251/507] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:16.384027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a09098-ac02-4e9e-afbc-5d9f4de9c647 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:16.425857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 257/508] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:16.426700 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2675a76-81da-4fe3-bbd3-a503d0ff5487 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:16.514684 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:16.520285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a09098-ac02-4e9e-afbc-5d9f4de9c647 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:16.546815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2675a76-81da-4fe3-bbd3-a503d0ff5487 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:16.569908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02eada3-fe0a-459d-8b17-9dc88269bf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:16.570581 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eada3-fe0a-459d-8b17-9dc88269bf24 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:16.570855 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eada3-fe0a-459d-8b17-9dc88269bf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:16.571235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eada3-fe0a-459d-8b17-9dc88269bf24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:16.597750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd72ed-8af4-4dc0-ab8e-94d3042b9f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:16.598591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd72ed-8af4-4dc0-ab8e-94d3042b9f33 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:16.598881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd72ed-8af4-4dc0-ab8e-94d3042b9f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:16.599157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd72ed-8af4-4dc0-ab8e-94d3042b9f33 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:16.607882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd72ed-8af4-4dc0-ab8e-94d3042b9f33 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:16.609490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd72ed-8af4-4dc0-ab8e-94d3042b9f33 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-92dd72ed-8af4-4dc0-ab8e-94d3042b9f33 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:16.622061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:16.623219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:16.624593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:16.624593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:16.624593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:16.624593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:16.624593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:16.624593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:16.624593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:16.624593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:16.624593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:10:16.624593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:16.628086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 258/509] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:16.628941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd72ed-8af4-4dc0-ab8e-94d3042b9f33 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:16.641354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:16.651051 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02eada3-fe0a-459d-8b17-9dc88269bf24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:16.652542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02eada3-fe0a-459d-8b17-9dc88269bf24 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:16.746157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd72ed-8af4-4dc0-ab8e-94d3042b9f33 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:16.762428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:16.767865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 252/510] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:16.769425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02eada3-fe0a-459d-8b17-9dc88269bf24 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:16.789954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaaf32-2fbe-4919-9c08-122b580797c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:16.790628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaaf32-2fbe-4919-9c08-122b580797c8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:16.791193 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaaf32-2fbe-4919-9c08-122b580797c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:16.791457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aaaf32-2fbe-4919-9c08-122b580797c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:16.801782 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aaaf32-2fbe-4919-9c08-122b580797c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-49aaaf32-2fbe-4919-9c08-122b580797c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:16.807480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:16.808385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:16.809205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 259/511] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:16.809987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaaf32-2fbe-4919-9c08-122b580797c8 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:16.874041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02eada3-fe0a-459d-8b17-9dc88269bf24 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:16.882909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:16.909471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4760b-f7df-4c96-a6b1-97e2d3f83ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:16.910126 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4760b-f7df-4c96-a6b1-97e2d3f83ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:16.910411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4760b-f7df-4c96-a6b1-97e2d3f83ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:16.910690 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4760b-f7df-4c96-a6b1-97e2d3f83ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:16.911392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4760b-f7df-4c96-a6b1-97e2d3f83ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:16.911704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4760b-f7df-4c96-a6b1-97e2d3f83ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:16.913086 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4760b-f7df-4c96-a6b1-97e2d3f83ff0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:16.918492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aaaf32-2fbe-4919-9c08-122b580797c8 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:16.928491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 253/512] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:16.930914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4760b-f7df-4c96-a6b1-97e2d3f83ff0 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:16.957371 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07b960-227d-42cf-b166-67cbee3a16f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:16.958038 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07b960-227d-42cf-b166-67cbee3a16f9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:16.958323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07b960-227d-42cf-b166-67cbee3a16f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:16.958599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07b960-227d-42cf-b166-67cbee3a16f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:16.969716 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07b960-227d-42cf-b166-67cbee3a16f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:16.971205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07b960-227d-42cf-b166-67cbee3a16f9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-7a07b960-227d-42cf-b166-67cbee3a16f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:16.989262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:16.990269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:16.991297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:16.991297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:16.991297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:16.991297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:16.991297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 260/513] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:16.991297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07b960-227d-42cf-b166-67cbee3a16f9 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:17.000621 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:17.044873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4760b-f7df-4c96-a6b1-97e2d3f83ff0 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:17.086419 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896a4f4-36f9-420e-92f9-15ab7d05bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:17.087107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896a4f4-36f9-420e-92f9-15ab7d05bca3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:17.087453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896a4f4-36f9-420e-92f9-15ab7d05bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:17.087606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896a4f4-36f9-420e-92f9-15ab7d05bca3 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:17.088512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896a4f4-36f9-420e-92f9-15ab7d05bca3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:17.088776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896a4f4-36f9-420e-92f9-15ab7d05bca3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:17.090322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896a4f4-36f9-420e-92f9-15ab7d05bca3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:17.098219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07b960-227d-42cf-b166-67cbee3a16f9 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:17.118310 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:17.130257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 254/514] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 08:10:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:17.130919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896a4f4-36f9-420e-92f9-15ab7d05bca3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:17.138945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f848c-20bf-4c6b-8d5b-b48bdeeecc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:17.139997 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f848c-20bf-4c6b-8d5b-b48bdeeecc6d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:17.140277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f848c-20bf-4c6b-8d5b-b48bdeeecc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:17.140578 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f848c-20bf-4c6b-8d5b-b48bdeeecc6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:17.151724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f848c-20bf-4c6b-8d5b-b48bdeeecc6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:17.153157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f848c-20bf-4c6b-8d5b-b48bdeeecc6d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-5b1f848c-20bf-4c6b-8d5b-b48bdeeecc6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:17.167447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:17.168378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:17.169228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:17.169228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:17.169228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:17.169228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:17.169228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 261/515] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:17.169493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f848c-20bf-4c6b-8d5b-b48bdeeecc6d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:17.233214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896a4f4-36f9-420e-92f9-15ab7d05bca3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:17.250540 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:17.268837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9785-ba5a-4368-8aaa-aefcde362e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:17.269382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9785-ba5a-4368-8aaa-aefcde362e08 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:17.269659 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9785-ba5a-4368-8aaa-aefcde362e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:17.269935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e9785-ba5a-4368-8aaa-aefcde362e08 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:17.270708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9785-ba5a-4368-8aaa-aefcde362e08 None admin] RBAC: Adding query filter params (name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:17.271013 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9785-ba5a-4368-8aaa-aefcde362e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:17.272387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e9785-ba5a-4368-8aaa-aefcde362e08 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:17.272504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f848c-20bf-4c6b-8d5b-b48bdeeecc6d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:17.280287 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 255/516] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:17.281692 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9785-ba5a-4368-8aaa-aefcde362e08 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:17.307688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055f795-2486-45fc-89b9-59c55a0a8f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:17.308304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055f795-2486-45fc-89b9-59c55a0a8f8b None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:17.308587 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055f795-2486-45fc-89b9-59c55a0a8f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:17.308863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055f795-2486-45fc-89b9-59c55a0a8f8b None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:17.309545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055f795-2486-45fc-89b9-59c55a0a8f8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:17.311015 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055f795-2486-45fc-89b9-59c55a0a8f8b None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:17.332543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 262/517] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:10:17 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:10:17.333366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055f795-2486-45fc-89b9-59c55a0a8f8b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:17.370500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:17.407223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e9785-ba5a-4368-8aaa-aefcde362e08 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:17.448979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acf84f-1d02-49c2-9ce1-300f0137ebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:17.449984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf84f-1d02-49c2-9ce1-300f0137ebf8 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:17.450486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf84f-1d02-49c2-9ce1-300f0137ebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:17.450957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf84f-1d02-49c2-9ce1-300f0137ebf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:17.451752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acf84f-1d02-49c2-9ce1-300f0137ebf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:17.452118 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acf84f-1d02-49c2-9ce1-300f0137ebf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:17.454158 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acf84f-1d02-49c2-9ce1-300f0137ebf8 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:17.461429 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055f795-2486-45fc-89b9-59c55a0a8f8b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:17.468867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 256/518] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:17.469671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acf84f-1d02-49c2-9ce1-300f0137ebf8 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:17.506762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fba47d-7707-4100-9e12-032e7028ad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:17.507416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fba47d-7707-4100-9e12-032e7028ad40 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:17.507701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fba47d-7707-4100-9e12-032e7028ad40 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:17.507976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fba47d-7707-4100-9e12-032e7028ad40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:17.519432 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:17.584769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acf84f-1d02-49c2-9ce1-300f0137ebf8 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:17.589812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fba47d-7707-4100-9e12-032e7028ad40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:17.591320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fba47d-7707-4100-9e12-032e7028ad40 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:17.623555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:17.623863 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee14cd-396b-406a-bc55-da5f402fa9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:17.624535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee14cd-396b-406a-bc55-da5f402fa9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:17.624809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee14cd-396b-406a-bc55-da5f402fa9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:17.625095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee14cd-396b-406a-bc55-da5f402fa9f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:17.625802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee14cd-396b-406a-bc55-da5f402fa9f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:17.626139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee14cd-396b-406a-bc55-da5f402fa9f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:17.627579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee14cd-396b-406a-bc55-da5f402fa9f5 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:17.640168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 257/519] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:17.642941 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee14cd-396b-406a-bc55-da5f402fa9f5 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:17.709848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 263/520] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:17.709848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fba47d-7707-4100-9e12-032e7028ad40 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:17.763521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:17.767034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee14cd-396b-406a-bc55-da5f402fa9f5 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:17.807490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081b975-b14c-4aae-aa3f-925993ec02e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:17.808059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081b975-b14c-4aae-aa3f-925993ec02e5 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:17.808341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081b975-b14c-4aae-aa3f-925993ec02e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:17.808621 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081b975-b14c-4aae-aa3f-925993ec02e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:17.820164 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081b975-b14c-4aae-aa3f-925993ec02e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:17.821724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081b975-b14c-4aae-aa3f-925993ec02e5 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:17.831161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fba47d-7707-4100-9e12-032e7028ad40 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-e081b975-b14c-4aae-aa3f-925993ec02e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:17.837422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:17.838371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:17.844818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:17.844818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:17.844818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:17.844818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:17.844818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 258/521] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:17.844818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081b975-b14c-4aae-aa3f-925993ec02e5 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:17.863001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:17.873759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7caf-3ae1-47f8-9d41-b41425dca883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:17.874724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7caf-3ae1-47f8-9d41-b41425dca883 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:17.875006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7caf-3ae1-47f8-9d41-b41425dca883 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:17.875276 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f7caf-3ae1-47f8-9d41-b41425dca883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:17.883163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f7caf-3ae1-47f8-9d41-b41425dca883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:17.884461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f7caf-3ae1-47f8-9d41-b41425dca883 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-ef1f7caf-3ae1-47f8-9d41-b41425dca883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:17.897807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:17.898726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:17.899588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:17.899588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:17.899588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:17.899588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:17.899588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:17.899588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:17.899588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:17.899588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:17.899588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 264/522] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:17.900524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7caf-3ae1-47f8-9d41-b41425dca883 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:17.958841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081b975-b14c-4aae-aa3f-925993ec02e5 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:17.997712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d6d6c-f67d-46cd-bef5-ad974201f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:17.998712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d6d6c-f67d-46cd-bef5-ad974201f682 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:17.998712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d6d6c-f67d-46cd-bef5-ad974201f682 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:17.998986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d6d6c-f67d-46cd-bef5-ad974201f682 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:18.005825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d6d6c-f67d-46cd-bef5-ad974201f682 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:18.007331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d6d6c-f67d-46cd-bef5-ad974201f682 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:18.019098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f7caf-3ae1-47f8-9d41-b41425dca883 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-555d6d6c-f67d-46cd-bef5-ad974201f682 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:18.019891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:18.020843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:18.021735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:18.021735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:18.021735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:18.021735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:18.021735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:18.021735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:18.021735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:18.021735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:18.021735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 259/523] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:18.022990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d6d6c-f67d-46cd-bef5-ad974201f682 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:18.040132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:18.066962 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e7c03-1df9-4618-bb99-3d968689af66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:18.067525 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e7c03-1df9-4618-bb99-3d968689af66 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:18.067813 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e7c03-1df9-4618-bb99-3d968689af66 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:18.068093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e7c03-1df9-4618-bb99-3d968689af66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:18.081168 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e7c03-1df9-4618-bb99-3d968689af66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:18.082805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e7c03-1df9-4618-bb99-3d968689af66 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-754e7c03-1df9-4618-bb99-3d968689af66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:18.099828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:18.100744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:18.102298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:18.102298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:18.102298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:18.102298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:18.102298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 265/524] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:18.102298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e7c03-1df9-4618-bb99-3d968689af66 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:18.138260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d6d6c-f67d-46cd-bef5-ad974201f682 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:18.151052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:18.175600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09105e-1875-4b2e-8e52-16d674741389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:18.176225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09105e-1875-4b2e-8e52-16d674741389 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:18.176660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09105e-1875-4b2e-8e52-16d674741389 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:18.176938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09105e-1875-4b2e-8e52-16d674741389 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:18.182191 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09105e-1875-4b2e-8e52-16d674741389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:18.182191 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09105e-1875-4b2e-8e52-16d674741389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:18.182191 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09105e-1875-4b2e-8e52-16d674741389 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:18.194894 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 260/525] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:18.195701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09105e-1875-4b2e-8e52-16d674741389 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:18.219495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e7c03-1df9-4618-bb99-3d968689af66 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:18.261834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe14dda-2106-4f4e-9d8b-9b64eeec421b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:18.262801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14dda-2106-4f4e-9d8b-9b64eeec421b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:18.263244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14dda-2106-4f4e-9d8b-9b64eeec421b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:18.263526 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe14dda-2106-4f4e-9d8b-9b64eeec421b None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:18.264283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe14dda-2106-4f4e-9d8b-9b64eeec421b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:18.264596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe14dda-2106-4f4e-9d8b-9b64eeec421b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:18.266713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe14dda-2106-4f4e-9d8b-9b64eeec421b None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:18.273037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:18.290582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 266/526] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:18.290582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe14dda-2106-4f4e-9d8b-9b64eeec421b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:18.315549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09105e-1875-4b2e-8e52-16d674741389 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:18.362345 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d01cfa-2954-4dc5-8617-0f394a6dff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:18.362995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01cfa-2954-4dc5-8617-0f394a6dff80 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:18.363276 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01cfa-2954-4dc5-8617-0f394a6dff80 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:18.363554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d01cfa-2954-4dc5-8617-0f394a6dff80 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:18.364329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d01cfa-2954-4dc5-8617-0f394a6dff80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:18.364641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d01cfa-2954-4dc5-8617-0f394a6dff80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:18.366134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d01cfa-2954-4dc5-8617-0f394a6dff80 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:18.389545 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 261/527] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:18.389545 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d01cfa-2954-4dc5-8617-0f394a6dff80 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:18.402527 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:18.406823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe14dda-2106-4f4e-9d8b-9b64eeec421b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:18.445343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9dfb6-16b2-4449-8138-70e13df73b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:18.446427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9dfb6-16b2-4449-8138-70e13df73b43 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:18.446715 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9dfb6-16b2-4449-8138-70e13df73b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:18.447219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9dfb6-16b2-4449-8138-70e13df73b43 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:18.447855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9dfb6-16b2-4449-8138-70e13df73b43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:18.448165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9dfb6-16b2-4449-8138-70e13df73b43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:18.449545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9dfb6-16b2-4449-8138-70e13df73b43 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:18.466032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 267/528] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:18.466032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9dfb6-16b2-4449-8138-70e13df73b43 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:18.498697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d01cfa-2954-4dc5-8617-0f394a6dff80 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:18.531882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:18.538583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38784b47-2ceb-4a5d-97aa-b12a537722f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:18.539503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784b47-2ceb-4a5d-97aa-b12a537722f9 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:18.539785 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784b47-2ceb-4a5d-97aa-b12a537722f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:18.540181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38784b47-2ceb-4a5d-97aa-b12a537722f9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:18.549207 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38784b47-2ceb-4a5d-97aa-b12a537722f9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:18.550836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38784b47-2ceb-4a5d-97aa-b12a537722f9 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-38784b47-2ceb-4a5d-97aa-b12a537722f9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:18.562499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:18.563414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:18.564322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:18.564322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:18.564322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:18.564322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:18.564322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:18.564322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:18.564322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:18.564322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:18.564322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:10:18.564322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:18.568166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 262/529] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:18.569608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38784b47-2ceb-4a5d-97aa-b12a537722f9 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:18.584057 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9dfb6-16b2-4449-8138-70e13df73b43 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:18.621310 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdced9-7165-4589-b960-fb512d66d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:18.621849 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdced9-7165-4589-b960-fb512d66d931 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:18.622186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdced9-7165-4589-b960-fb512d66d931 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:18.622452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdced9-7165-4589-b960-fb512d66d931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:18.623238 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdced9-7165-4589-b960-fb512d66d931 None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=739b8f31f1d74459a7348c3ed699812c) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:18.623546 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdced9-7165-4589-b960-fb512d66d931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:18.625008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdced9-7165-4589-b960-fb512d66d931 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:18.640917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 268/530] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:18 2022] GET /identity/v3/role_assignments?user.id=739b8f31f1d74459a7348c3ed699812c&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:18.641706 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdced9-7165-4589-b960-fb512d66d931 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:18.678645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:18.683586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38784b47-2ceb-4a5d-97aa-b12a537722f9 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:18.722547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676d736-5eb1-4bf9-9c8b-5c1be4612c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:18.723187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676d736-5eb1-4bf9-9c8b-5c1be4612c8b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:18.723462 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676d736-5eb1-4bf9-9c8b-5c1be4612c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:18.723733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676d736-5eb1-4bf9-9c8b-5c1be4612c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:18.724605 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676d736-5eb1-4bf9-9c8b-5c1be4612c8b None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=93143507a8784a30bc6b4a5e1f24f0b6) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:18.724942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676d736-5eb1-4bf9-9c8b-5c1be4612c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:18.726524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676d736-5eb1-4bf9-9c8b-5c1be4612c8b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:18.733080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 263/531] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:18 2022] GET /identity/v3/role_assignments?user.id=93143507a8784a30bc6b4a5e1f24f0b6&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:18.734571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676d736-5eb1-4bf9-9c8b-5c1be4612c8b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:18.776656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdced9-7165-4589-b960-fb512d66d931 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:18.804678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:18.818761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eac01a-a3b1-4a51-b4b4-ab1c87519309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:18.819483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eac01a-a3b1-4a51-b4b4-ab1c87519309 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:18.819864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eac01a-a3b1-4a51-b4b4-ab1c87519309 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:18.820036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eac01a-a3b1-4a51-b4b4-ab1c87519309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:18.828665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eac01a-a3b1-4a51-b4b4-ab1c87519309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:18.830189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eac01a-a3b1-4a51-b4b4-ab1c87519309 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-87eac01a-a3b1-4a51-b4b4-ab1c87519309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:18.844372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:18.845305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:18.846211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:18.846211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:18.846211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:18.846211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:18.846211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:18.846211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:18.846211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:18.846211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:18.850234 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 269/532] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:18.852354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eac01a-a3b1-4a51-b4b4-ab1c87519309 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:18.910692 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676d736-5eb1-4bf9-9c8b-5c1be4612c8b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:18.983199 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77276600-b6d0-40c8-9b87-045b98ca93ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:18.983983 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77276600-b6d0-40c8-9b87-045b98ca93ac None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:18.984262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77276600-b6d0-40c8-9b87-045b98ca93ac None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:18.984534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77276600-b6d0-40c8-9b87-045b98ca93ac None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:18.985332 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77276600-b6d0-40c8-9b87-045b98ca93ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:18.985636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77276600-b6d0-40c8-9b87-045b98ca93ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:18.986399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:18.987951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77276600-b6d0-40c8-9b87-045b98ca93ac None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:19.013151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eac01a-a3b1-4a51-b4b4-ab1c87519309 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:19.032188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 264/533] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Aug 2 08:10:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:19.036564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77276600-b6d0-40c8-9b87-045b98ca93ac None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:19.089584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a3984-a7d5-4fd3-9058-9681e43432b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:19.090369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3984-a7d5-4fd3-9058-9681e43432b5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:19.090633 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3984-a7d5-4fd3-9058-9681e43432b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:19.090915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3984-a7d5-4fd3-9058-9681e43432b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:19.091681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a3984-a7d5-4fd3-9058-9681e43432b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:19.091994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a3984-a7d5-4fd3-9058-9681e43432b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:19.093484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a3984-a7d5-4fd3-9058-9681e43432b5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:19.123610 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 270/534] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:19.127581 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a3984-a7d5-4fd3-9058-9681e43432b5 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:19.229136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77276600-b6d0-40c8-9b87-045b98ca93ac None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:19.263280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:19.303607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55567c3-1b0e-49f7-a77c-e1354af2ea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:19.304244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55567c3-1b0e-49f7-a77c-e1354af2ea8c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:19.304534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55567c3-1b0e-49f7-a77c-e1354af2ea8c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:19.304807 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55567c3-1b0e-49f7-a77c-e1354af2ea8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:19.307620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a3984-a7d5-4fd3-9058-9681e43432b5 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:19.376832 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a45f3a-6e77-485e-8bbe-cf399e504279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:19.377843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a45f3a-6e77-485e-8bbe-cf399e504279 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:19.378151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a45f3a-6e77-485e-8bbe-cf399e504279 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:19.378430 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a45f3a-6e77-485e-8bbe-cf399e504279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:19.379228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a45f3a-6e77-485e-8bbe-cf399e504279 None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=6557be84abb6469d95157570517512fc) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:19.379540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a45f3a-6e77-485e-8bbe-cf399e504279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:19.380987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a45f3a-6e77-485e-8bbe-cf399e504279 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:19.402523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 271/535] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:19 2022] GET /identity/v3/role_assignments?user.id=6557be84abb6469d95157570517512fc&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:19.435019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55567c3-1b0e-49f7-a77c-e1354af2ea8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:19.436524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55567c3-1b0e-49f7-a77c-e1354af2ea8c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:19.500197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad9707-e5e4-4019-8b25-1d6e66d79f99 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:19.500493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad9707-e5e4-4019-8b25-1d6e66d79f99 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:19.500659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad9707-e5e4-4019-8b25-1d6e66d79f99 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:19.502381 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 272/536] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:19.513361 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba093-da4e-44e2-b182-0670a19978c8 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:19.513687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba093-da4e-44e2-b182-0670a19978c8 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:19.514240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ba093-da4e-44e2-b182-0670a19978c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:19.551113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-b66ba093-da4e-44e2-b182-0670a19978c8 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:19.552479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b66ba093-da4e-44e2-b182-0670a19978c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:19.557665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:19.599216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 265/537] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:19.607056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55567c3-1b0e-49f7-a77c-e1354af2ea8c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:19.647681 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:19.648094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 273/538] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:10:19.676525 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba093-da4e-44e2-b182-0670a19978c8 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:19.746448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55567c3-1b0e-49f7-a77c-e1354af2ea8c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:19.785138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ba093-da4e-44e2-b182-0670a19978c8 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:19.789519 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cca35c-a412-4792-bad0-41b5475ec9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:19.790206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cca35c-a412-4792-bad0-41b5475ec9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:19.790494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cca35c-a412-4792-bad0-41b5475ec9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:19.791027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cca35c-a412-4792-bad0-41b5475ec9a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:19.806228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cca35c-a412-4792-bad0-41b5475ec9a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:19.807738 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cca35c-a412-4792-bad0-41b5475ec9a0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:19.824353 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1edc9-1448-446d-a40a-5b6895c4f982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:19.825350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1edc9-1448-446d-a40a-5b6895c4f982 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:19.825823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1edc9-1448-446d-a40a-5b6895c4f982 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:19.826319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1edc9-1448-446d-a40a-5b6895c4f982 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:19.833866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-a7cca35c-a412-4792-bad0-41b5475ec9a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:19.833990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:19.835185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:19.836077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:19.836077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:19.836077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:19.836077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:19.840364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 266/539] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:19.841393 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1edc9-1448-446d-a40a-5b6895c4f982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:19.841833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cca35c-a412-4792-bad0-41b5475ec9a0 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-c3d1edc9-1448-446d-a40a-5b6895c4f982 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:19.848037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:19.849060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:19.849855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:19.852157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 274/540] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:19.859509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1edc9-1448-446d-a40a-5b6895c4f982 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:19.975529 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:20.019626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cca35c-a412-4792-bad0-41b5475ec9a0 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:20.058396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1edc9-1448-446d-a40a-5b6895c4f982 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:20.063968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8882b-9f29-4fb7-b996-1cf3a3a55ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:20.064618 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8882b-9f29-4fb7-b996-1cf3a3a55ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:20.064900 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8882b-9f29-4fb7-b996-1cf3a3a55ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:20.065173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8882b-9f29-4fb7-b996-1cf3a3a55ae0 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:20.065879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8882b-9f29-4fb7-b996-1cf3a3a55ae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:20.066217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8882b-9f29-4fb7-b996-1cf3a3a55ae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:20.067961 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8882b-9f29-4fb7-b996-1cf3a3a55ae0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:20.092153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 267/541] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:20.093871 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8882b-9f29-4fb7-b996-1cf3a3a55ae0 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:20.097793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209f687-b9f3-4184-a662-0501e739599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:20.098671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209f687-b9f3-4184-a662-0501e739599a None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:20.099125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209f687-b9f3-4184-a662-0501e739599a None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:20.099565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209f687-b9f3-4184-a662-0501e739599a None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:20.100603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209f687-b9f3-4184-a662-0501e739599a None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:20.101186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209f687-b9f3-4184-a662-0501e739599a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:20.102802 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209f687-b9f3-4184-a662-0501e739599a None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:20.112548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 275/542] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:20.119052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209f687-b9f3-4184-a662-0501e739599a None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:20.184592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:20.233227 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209f687-b9f3-4184-a662-0501e739599a None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:20.271657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ad451-e7c5-43dc-9dd0-135e802a925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:20.272699 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ad451-e7c5-43dc-9dd0-135e802a925c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:20.273180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ad451-e7c5-43dc-9dd0-135e802a925c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:20.273650 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ad451-e7c5-43dc-9dd0-135e802a925c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:20.286458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ad451-e7c5-43dc-9dd0-135e802a925c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:20.288238 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ad451-e7c5-43dc-9dd0-135e802a925c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:20.300216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8882b-9f29-4fb7-b996-1cf3a3a55ae0 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-a33ad451-e7c5-43dc-9dd0-135e802a925c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:20.306846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:20.307694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:20.308982 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:20.308982 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:20.308982 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:20.308982 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:20.311197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 276/543] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:20.316694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ad451-e7c5-43dc-9dd0-135e802a925c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:20.372382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:20.390995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2317786-4773-48fb-89d6-8f48ad3f27b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:20.391982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317786-4773-48fb-89d6-8f48ad3f27b9 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:20.393723 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317786-4773-48fb-89d6-8f48ad3f27b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:20.394464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2317786-4773-48fb-89d6-8f48ad3f27b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:20.410702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2317786-4773-48fb-89d6-8f48ad3f27b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:20.412448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2317786-4773-48fb-89d6-8f48ad3f27b9 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-f2317786-4773-48fb-89d6-8f48ad3f27b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:20.440123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:20.441087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:20.441938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:20.441938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:20.441938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:20.441938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:20.441938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:20.441938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:20.441938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:20.441938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:20.445282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 268/544] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:20.451502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2317786-4773-48fb-89d6-8f48ad3f27b9 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:20.477371 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ad451-e7c5-43dc-9dd0-135e802a925c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:20.491363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:20.515773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802b2bc-f539-497e-aa02-18631bb188d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:20.516634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802b2bc-f539-497e-aa02-18631bb188d6 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:20.517078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802b2bc-f539-497e-aa02-18631bb188d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:20.517487 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802b2bc-f539-497e-aa02-18631bb188d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:20.518357 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802b2bc-f539-497e-aa02-18631bb188d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:20.518799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802b2bc-f539-497e-aa02-18631bb188d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:20.520468 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802b2bc-f539-497e-aa02-18631bb188d6 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:20.535490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 277/545] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:20.541780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802b2bc-f539-497e-aa02-18631bb188d6 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:20.678766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2317786-4773-48fb-89d6-8f48ad3f27b9 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:20.711421 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802b2bc-f539-497e-aa02-18631bb188d6 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:20.750563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1981ab6-7976-49b8-8a92-7c1c3a9caad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:20.751610 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981ab6-7976-49b8-8a92-7c1c3a9caad9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:20.752031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981ab6-7976-49b8-8a92-7c1c3a9caad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:20.752444 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1981ab6-7976-49b8-8a92-7c1c3a9caad9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:20.761127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1981ab6-7976-49b8-8a92-7c1c3a9caad9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:20.762907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1981ab6-7976-49b8-8a92-7c1c3a9caad9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-f1981ab6-7976-49b8-8a92-7c1c3a9caad9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:20.776507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:20.777411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:20.778331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:20.778331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:20.778331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:20.778331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:20.778331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:20.778331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:20.778331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:20.778331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:20.778331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:20.778331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:20.781483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 278/546] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:20.785949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5188-c511-4340-8451-4caffde6c082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:20.785949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5188-c511-4340-8451-4caffde6c082 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:20.785949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5188-c511-4340-8451-4caffde6c082 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:20.785949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c5188-c511-4340-8451-4caffde6c082 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:20.786294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5188-c511-4340-8451-4caffde6c082 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:20.786294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5188-c511-4340-8451-4caffde6c082 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:20.790508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c5188-c511-4340-8451-4caffde6c082 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:20.793657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1981ab6-7976-49b8-8a92-7c1c3a9caad9 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:20.823745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 269/547] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:20.829313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5188-c511-4340-8451-4caffde6c082 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:20.890477 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:20.935241 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1981ab6-7976-49b8-8a92-7c1c3a9caad9 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:20.978688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62cb45-9764-44b7-af93-c37cb919e433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:20.979779 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62cb45-9764-44b7-af93-c37cb919e433 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:20.980269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62cb45-9764-44b7-af93-c37cb919e433 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:20.980740 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62cb45-9764-44b7-af93-c37cb919e433 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:20.981794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62cb45-9764-44b7-af93-c37cb919e433 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:20.982332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62cb45-9764-44b7-af93-c37cb919e433 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:20.984810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62cb45-9764-44b7-af93-c37cb919e433 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:20.987555 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:21.009471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 279/548] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 08:10:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:21.015350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06bae1-d17c-4001-80d4-d4322ee3d54c None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:21.015644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06bae1-d17c-4001-80d4-d4322ee3d54c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:21.015920 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06bae1-d17c-4001-80d4-d4322ee3d54c None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:21.017324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 280/549] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:21.017883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06bae1-d17c-4001-80d4-d4322ee3d54c None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:21.057472 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c5188-c511-4340-8451-4caffde6c082 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:21.093560 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b5ca1-e15f-415b-be44-7b39469720aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:21.094229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b5ca1-e15f-415b-be44-7b39469720aa None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:21.094544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b5ca1-e15f-415b-be44-7b39469720aa None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:21.094819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b5ca1-e15f-415b-be44-7b39469720aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:21.095831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b5ca1-e15f-415b-be44-7b39469720aa None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=e68c134016414ea5b851bde233ed9951) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:21.095960 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b5ca1-e15f-415b-be44-7b39469720aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:21.097332 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b5ca1-e15f-415b-be44-7b39469720aa None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:21.103770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 270/550] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:20 2022] GET /identity/v3/role_assignments?user.id=e68c134016414ea5b851bde233ed9951&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:21.105006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bdbb-40f8-492c-b4bf-a04f70e51277 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:21.105298 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bdbb-40f8-492c-b4bf-a04f70e51277 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:21.105577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bdbb-40f8-492c-b4bf-a04f70e51277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:21.130470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-d785bdbb-40f8-492c-b4bf-a04f70e51277 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:21.132596 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d785bdbb-40f8-492c-b4bf-a04f70e51277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:21.142477 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:21.163179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06bae1-d17c-4001-80d4-d4322ee3d54c None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:21.208214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bc672-5da6-48c8-a6ac-460defa82ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:21.208763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc672-5da6-48c8-a6ac-460defa82ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:21.209048 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc672-5da6-48c8-a6ac-460defa82ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:21.209674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bc672-5da6-48c8-a6ac-460defa82ef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:21.225146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 271/551] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:21.227302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f487a2-a4de-4139-80c0-5fcc1ed1b326 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:21.227810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f487a2-a4de-4139-80c0-5fcc1ed1b326 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:21.228439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f487a2-a4de-4139-80c0-5fcc1ed1b326 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:21.230877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 272/552] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:21.237078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ba7a6-a456-4f8f-91bf-8744c8f2e273 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:21.237355 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ba7a6-a456-4f8f-91bf-8744c8f2e273 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:21.237435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ba7a6-a456-4f8f-91bf-8744c8f2e273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:21.267527 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-849ba7a6-a456-4f8f-91bf-8744c8f2e273 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:21.268737 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-849ba7a6-a456-4f8f-91bf-8744c8f2e273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:21.318263 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bc672-5da6-48c8-a6ac-460defa82ef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:21.319883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bc672-5da6-48c8-a6ac-460defa82ef2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:21.346368 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:21.360127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 273/553] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:10:21.360127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ba7a6-a456-4f8f-91bf-8744c8f2e273 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:21.443158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:21.456303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 281/554] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:21.457209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bc672-5da6-48c8-a6ac-460defa82ef2 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:21.483077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ba7a6-a456-4f8f-91bf-8744c8f2e273 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:21.520471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc96c2-0f48-437b-8da1-aa7a7a597a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:21.521651 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc96c2-0f48-437b-8da1-aa7a7a597a8e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:21.522462 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc96c2-0f48-437b-8da1-aa7a7a597a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:21.523182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc96c2-0f48-437b-8da1-aa7a7a597a8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:21.537389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc96c2-0f48-437b-8da1-aa7a7a597a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-eccc96c2-0f48-437b-8da1-aa7a7a597a8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:21.544468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:21.545492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:21.546978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:21.550380 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 274/555] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:21.551763 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc96c2-0f48-437b-8da1-aa7a7a597a8e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:21.576553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bc672-5da6-48c8-a6ac-460defa82ef2 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:21.598366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:21.623617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500e17d-9eb5-4f13-a777-22c1adc39f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:21.624290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500e17d-9eb5-4f13-a777-22c1adc39f8b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:21.624578 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500e17d-9eb5-4f13-a777-22c1adc39f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:21.624941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500e17d-9eb5-4f13-a777-22c1adc39f8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:21.636687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500e17d-9eb5-4f13-a777-22c1adc39f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-e500e17d-9eb5-4f13-a777-22c1adc39f8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:21.642666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:21.643697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:21.644537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:21.649058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 282/556] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:21.649928 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500e17d-9eb5-4f13-a777-22c1adc39f8b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:21.690810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc96c2-0f48-437b-8da1-aa7a7a597a8e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:21.712130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:21.741444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790675-0e21-49d4-9ebb-3974f2b81fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:21.742361 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790675-0e21-49d4-9ebb-3974f2b81fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:21.742786 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790675-0e21-49d4-9ebb-3974f2b81fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:21.743978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b790675-0e21-49d4-9ebb-3974f2b81fe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:21.759743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b790675-0e21-49d4-9ebb-3974f2b81fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:21.762153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b790675-0e21-49d4-9ebb-3974f2b81fe1 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:21.771596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500e17d-9eb5-4f13-a777-22c1adc39f8b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-2b790675-0e21-49d4-9ebb-3974f2b81fe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:21.785790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:21.787440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:21.788520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:21.788520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:21.788520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:21.788520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:21.790982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 275/557] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:21.792766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790675-0e21-49d4-9ebb-3974f2b81fe1 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:21.816843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9ac6b-f3be-43c8-afce-0bfed968bebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:21.817648 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9ac6b-f3be-43c8-afce-0bfed968bebc None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:21.818043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9ac6b-f3be-43c8-afce-0bfed968bebc None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:21.818427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9ac6b-f3be-43c8-afce-0bfed968bebc None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:21.819262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9ac6b-f3be-43c8-afce-0bfed968bebc None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:21.819669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9ac6b-f3be-43c8-afce-0bfed968bebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:21.821261 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9ac6b-f3be-43c8-afce-0bfed968bebc None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:21.835935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 283/558] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:21.837009 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9ac6b-f3be-43c8-afce-0bfed968bebc None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:21.902579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:21.923421 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b790675-0e21-49d4-9ebb-3974f2b81fe1 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:21.958696 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9ac6b-f3be-43c8-afce-0bfed968bebc None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:21.960178 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf3ee1-3322-4fab-824b-9133b70e87f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:21.960799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf3ee1-3322-4fab-824b-9133b70e87f6 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:21.961081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf3ee1-3322-4fab-824b-9133b70e87f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:21.961360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf3ee1-3322-4fab-824b-9133b70e87f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:21.962118 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf3ee1-3322-4fab-824b-9133b70e87f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:21.962426 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf3ee1-3322-4fab-824b-9133b70e87f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:21.963804 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf3ee1-3322-4fab-824b-9133b70e87f6 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:21.972805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:21.978304 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 276/559] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:21.979195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf3ee1-3322-4fab-824b-9133b70e87f6 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:21.998714 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fd47e-93b9-46fb-a367-656c97e7378e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:21.999781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fd47e-93b9-46fb-a367-656c97e7378e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.000069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fd47e-93b9-46fb-a367-656c97e7378e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.000349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fd47e-93b9-46fb-a367-656c97e7378e None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.001052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fd47e-93b9-46fb-a367-656c97e7378e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:22.001362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fd47e-93b9-46fb-a367-656c97e7378e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:22.002792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fd47e-93b9-46fb-a367-656c97e7378e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:22.020581 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 284/560] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:22.021819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a0a28-2b40-4a3c-9ada-1ee060175840 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.022183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a0a28-2b40-4a3c-9ada-1ee060175840 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.022417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a0a28-2b40-4a3c-9ada-1ee060175840 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.023851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 285/561] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:22.027234 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a0a28-2b40-4a3c-9ada-1ee060175840 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:22.091565 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf3ee1-3322-4fab-824b-9133b70e87f6 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:22.127764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac6375-ec69-4a7f-9799-37878e213182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:22.128411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac6375-ec69-4a7f-9799-37878e213182 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.128692 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac6375-ec69-4a7f-9799-37878e213182 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.128968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac6375-ec69-4a7f-9799-37878e213182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.136649 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a0a28-2b40-4a3c-9ada-1ee060175840 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:22.141087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac6375-ec69-4a7f-9799-37878e213182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:22.142837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac6375-ec69-4a7f-9799-37878e213182 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:22.145887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-bbac6375-ec69-4a7f-9799-37878e213182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:22.159548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:22.160473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:22.161383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:22.161383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:22.161383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:22.161383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:22.167704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 277/562] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:22.168667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac6375-ec69-4a7f-9799-37878e213182 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:22.172179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ae623-93d2-41c9-8e88-97e30683f52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:22.172823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae623-93d2-41c9-8e88-97e30683f52c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.173113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae623-93d2-41c9-8e88-97e30683f52c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.173391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae623-93d2-41c9-8e88-97e30683f52c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.184056 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ae623-93d2-41c9-8e88-97e30683f52c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:22.185507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ae623-93d2-41c9-8e88-97e30683f52c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-fd5ae623-93d2-41c9-8e88-97e30683f52c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:22.200882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:22.201800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:22.203322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:22.203322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:22.203322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:22.203322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:22.203322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 286/563] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:22.203805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11538d01-9646-4b77-8270-e1955651e592 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.204091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11538d01-9646-4b77-8270-e1955651e592 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11538d01-9646-4b77-8270-e1955651e592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.222558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-11538d01-9646-4b77-8270-e1955651e592 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:22.223754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-11538d01-9646-4b77-8270-e1955651e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:22.241189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:22.284014 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac6375-ec69-4a7f-9799-37878e213182 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:22.299267 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 287/564] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:22.300405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11538d01-9646-4b77-8270-e1955651e592 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:22.326294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a58849-e5f8-4093-920b-50868e726fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:22.326931 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a58849-e5f8-4093-920b-50868e726fbc None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.327579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a58849-e5f8-4093-920b-50868e726fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.327579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a58849-e5f8-4093-920b-50868e726fbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.334221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a58849-e5f8-4093-920b-50868e726fbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:22.335647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a58849-e5f8-4093-920b-50868e726fbc None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-45a58849-e5f8-4093-920b-50868e726fbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:22.347195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:22.348722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:22.349865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:22.349865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:22.349865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:22.349865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:22.349865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:22.349865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:22.349865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:22.349865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:22.359292 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 278/565] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:22.359292 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a58849-e5f8-4093-920b-50868e726fbc None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:22.420813 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11538d01-9646-4b77-8270-e1955651e592 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:22.425395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:22.458211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f1901-9bcc-42f1-93f7-3c4fe251a966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:22.458999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f1901-9bcc-42f1-93f7-3c4fe251a966 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.459384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f1901-9bcc-42f1-93f7-3c4fe251a966 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.459757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f1901-9bcc-42f1-93f7-3c4fe251a966 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.460563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f1901-9bcc-42f1-93f7-3c4fe251a966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:22.460951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f1901-9bcc-42f1-93f7-3c4fe251a966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:22.462376 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f1901-9bcc-42f1-93f7-3c4fe251a966 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:22.473744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 288/566] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:22.474560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f1901-9bcc-42f1-93f7-3c4fe251a966 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:22.475091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a58849-e5f8-4093-920b-50868e726fbc None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:22.495504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:22.513047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa3a7f-b1ac-4d25-a821-447867be2f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:22.513677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3a7f-b1ac-4d25-a821-447867be2f3c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.513963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3a7f-b1ac-4d25-a821-447867be2f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.514278 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3a7f-b1ac-4d25-a821-447867be2f3c None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.514969 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa3a7f-b1ac-4d25-a821-447867be2f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:22.515275 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa3a7f-b1ac-4d25-a821-447867be2f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:22.516632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa3a7f-b1ac-4d25-a821-447867be2f3c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:22.528683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 279/567] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:22.529491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa3a7f-b1ac-4d25-a821-447867be2f3c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:22.600020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f1901-9bcc-42f1-93f7-3c4fe251a966 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:22.637034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa3a7f-b1ac-4d25-a821-447867be2f3c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:22.638964 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca1261-63e0-437f-80a6-71e0c4c69fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:22.640249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1261-63e0-437f-80a6-71e0c4c69fcf None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.640249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1261-63e0-437f-80a6-71e0c4c69fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.640443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1261-63e0-437f-80a6-71e0c4c69fcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.651647 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca1261-63e0-437f-80a6-71e0c4c69fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:22.655254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-d0ca1261-63e0-437f-80a6-71e0c4c69fcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:22.657900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:22.659286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 289/568] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:22.660325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca1261-63e0-437f-80a6-71e0c4c69fcf None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:22.685428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c5ac8-a310-48f9-a817-50e961ac716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:22.686113 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5ac8-a310-48f9-a817-50e961ac716f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.686398 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5ac8-a310-48f9-a817-50e961ac716f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.686706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5ac8-a310-48f9-a817-50e961ac716f None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.687495 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c5ac8-a310-48f9-a817-50e961ac716f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:22.687865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c5ac8-a310-48f9-a817-50e961ac716f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:22.689344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c5ac8-a310-48f9-a817-50e961ac716f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:22.701967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 280/569] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:22.702844 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c5ac8-a310-48f9-a817-50e961ac716f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:22.751884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:22.783013 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca1261-63e0-437f-80a6-71e0c4c69fcf None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:22.813810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c5ac8-a310-48f9-a817-50e961ac716f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:22.820876 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c08791-8a80-442c-ab19-75c191fdd869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:22.821605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c08791-8a80-442c-ab19-75c191fdd869 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.821961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c08791-8a80-442c-ab19-75c191fdd869 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.822351 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c08791-8a80-442c-ab19-75c191fdd869 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.831191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c08791-8a80-442c-ab19-75c191fdd869 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:22.832909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c08791-8a80-442c-ab19-75c191fdd869 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-c7c08791-8a80-442c-ab19-75c191fdd869 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:22.845869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:22.847107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 290/570] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 08:10:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:22.848599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c08791-8a80-442c-ab19-75c191fdd869 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:22.854150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c6bf-b663-48f5-9c73-f4f08815701f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:22.854749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c6bf-b663-48f5-9c73-f4f08815701f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.855037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c6bf-b663-48f5-9c73-f4f08815701f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.855296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165c6bf-b663-48f5-9c73-f4f08815701f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:22.864373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165c6bf-b663-48f5-9c73-f4f08815701f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:22.866058 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165c6bf-b663-48f5-9c73-f4f08815701f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-4165c6bf-b663-48f5-9c73-f4f08815701f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:22.878446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:22.879615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:22.880585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:22.880585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:22.880585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:22.880585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:22.880585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:22.880585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:22.880585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:22.880585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:22.880585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:10:22.880585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:22.880585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 281/571] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:22.881346 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c6bf-b663-48f5-9c73-f4f08815701f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:22.920458 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:22.962504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c08791-8a80-442c-ab19-75c191fdd869 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:22.993668 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165c6bf-b663-48f5-9c73-f4f08815701f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:22.998228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0199e-a936-412f-aa25-28893e9e91f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:22.998857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0199e-a936-412f-aa25-28893e9e91f5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:22.999161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0199e-a936-412f-aa25-28893e9e91f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:22.999441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0199e-a936-412f-aa25-28893e9e91f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.000161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0199e-a936-412f-aa25-28893e9e91f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:23.000469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0199e-a936-412f-aa25-28893e9e91f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:23.001843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0199e-a936-412f-aa25-28893e9e91f5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:23.003388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:23.014158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 291/572] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:23.015084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0199e-a936-412f-aa25-28893e9e91f5 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:23.038058 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba97480-628e-4a66-a2f1-7394cd39264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:23.039108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba97480-628e-4a66-a2f1-7394cd39264f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.039420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba97480-628e-4a66-a2f1-7394cd39264f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.039947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba97480-628e-4a66-a2f1-7394cd39264f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.041000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba97480-628e-4a66-a2f1-7394cd39264f None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=e02b653d2f5e4faca2906b2fbd1bfc5c) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:23.041483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba97480-628e-4a66-a2f1-7394cd39264f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:23.043289 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba97480-628e-4a66-a2f1-7394cd39264f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:23.050234 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 282/573] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:22 2022] GET /identity/v3/role_assignments?user.id=e02b653d2f5e4faca2906b2fbd1bfc5c&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:23.051025 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba97480-628e-4a66-a2f1-7394cd39264f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:23.164012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0199e-a936-412f-aa25-28893e9e91f5 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:23.172612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:23.176105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba97480-628e-4a66-a2f1-7394cd39264f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:23.213833 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b22d2e-8108-4d0b-8d2a-8751416ac1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:23.214508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b22d2e-8108-4d0b-8d2a-8751416ac1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.214792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b22d2e-8108-4d0b-8d2a-8751416ac1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.215067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b22d2e-8108-4d0b-8d2a-8751416ac1f2 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.215925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5476de-fb9f-4576-a410-09979edb358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:23.216050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b22d2e-8108-4d0b-8d2a-8751416ac1f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:23.216269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b22d2e-8108-4d0b-8d2a-8751416ac1f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:23.216549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5476de-fb9f-4576-a410-09979edb358f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.216830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5476de-fb9f-4576-a410-09979edb358f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.217106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5476de-fb9f-4576-a410-09979edb358f None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.217692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b22d2e-8108-4d0b-8d2a-8751416ac1f2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:23.217960 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5476de-fb9f-4576-a410-09979edb358f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:23.218791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5476de-fb9f-4576-a410-09979edb358f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:23.220205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5476de-fb9f-4576-a410-09979edb358f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:23.237517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 292/574] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 08:10:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:23.238382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b22d2e-8108-4d0b-8d2a-8751416ac1f2 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:23.238967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 283/575] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 08:10:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:23.240521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e82be-0dad-4a08-bd14-2d3869ea94aa None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.241060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e82be-0dad-4a08-bd14-2d3869ea94aa None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.241542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e82be-0dad-4a08-bd14-2d3869ea94aa None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.243047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 284/576] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:23.243961 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e82be-0dad-4a08-bd14-2d3869ea94aa None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:23.313874 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:23.360159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e82be-0dad-4a08-bd14-2d3869ea94aa None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:23.370708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b22d2e-8108-4d0b-8d2a-8751416ac1f2 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:23.399594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c9edb-1585-443e-8e4d-bf16cdf74eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:23.400257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9edb-1585-443e-8e4d-bf16cdf74eca None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.400538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9edb-1585-443e-8e4d-bf16cdf74eca None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.400813 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c9edb-1585-443e-8e4d-bf16cdf74eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.412203 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c9edb-1585-443e-8e4d-bf16cdf74eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:23.413677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c9edb-1585-443e-8e4d-bf16cdf74eca None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:23.414818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372b3e3-3145-41cf-bf8e-9cd9585ba5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:23.415472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b3e3-3145-41cf-bf8e-9cd9585ba5de None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.416380 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b3e3-3145-41cf-bf8e-9cd9585ba5de None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.416661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372b3e3-3145-41cf-bf8e-9cd9585ba5de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.428446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372b3e3-3145-41cf-bf8e-9cd9585ba5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:23.429785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372b3e3-3145-41cf-bf8e-9cd9585ba5de None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-4b3c9edb-1585-443e-8e4d-bf16cdf74eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:23.430268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:23.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:23.432085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:23.432085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:23.432085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:23.432085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:23.432085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 285/577] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:23.432364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c9edb-1585-443e-8e4d-bf16cdf74eca None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:23.445800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-0372b3e3-3145-41cf-bf8e-9cd9585ba5de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:23.453542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:23.454959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:23.456087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:23.456087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:23.456087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:23.456087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:23.459632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 293/578] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:23.460622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25556-5895-4dbc-9a43-1ec9f32a7d18 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.460908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25556-5895-4dbc-9a43-1ec9f32a7d18 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.461463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25556-5895-4dbc-9a43-1ec9f32a7d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.478666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-9fd25556-5895-4dbc-9a43-1ec9f32a7d18 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:23.479879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9fd25556-5895-4dbc-9a43-1ec9f32a7d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:23.557650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c9edb-1585-443e-8e4d-bf16cdf74eca None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:23.559444 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 294/579] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:23.560333 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd25556-5895-4dbc-9a43-1ec9f32a7d18 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:23.606060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:23.611343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7ce98-f32c-485d-9288-6bdbdf751ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:23.612013 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ce98-f32c-485d-9288-6bdbdf751ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.612302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ce98-f32c-485d-9288-6bdbdf751ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.612567 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7ce98-f32c-485d-9288-6bdbdf751ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.625034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7ce98-f32c-485d-9288-6bdbdf751ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:23.626547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7ce98-f32c-485d-9288-6bdbdf751ee3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-b3e7ce98-f32c-485d-9288-6bdbdf751ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:23.643095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:23.644120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:23.645034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:23.645034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:23.645034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:23.645034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:23.645034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 286/580] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:23.645410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7ce98-f32c-485d-9288-6bdbdf751ee3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:23.697792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd25556-5895-4dbc-9a43-1ec9f32a7d18 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:23.719486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:23.736316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761d498-7f65-499d-9d9c-d69a750d8769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:23.737043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761d498-7f65-499d-9d9c-d69a750d8769 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.737586 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761d498-7f65-499d-9d9c-d69a750d8769 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.737936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761d498-7f65-499d-9d9c-d69a750d8769 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.738734 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761d498-7f65-499d-9d9c-d69a750d8769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:23.739232 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761d498-7f65-499d-9d9c-d69a750d8769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:23.740790 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761d498-7f65-499d-9d9c-d69a750d8769 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:23.758002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 295/581] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:23.758002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761d498-7f65-499d-9d9c-d69a750d8769 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:23.773434 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7ce98-f32c-485d-9288-6bdbdf751ee3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:23.814071 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12aabe-9f2f-478c-8aea-238713004c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:23.814700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12aabe-9f2f-478c-8aea-238713004c76 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.814980 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12aabe-9f2f-478c-8aea-238713004c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.815257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12aabe-9f2f-478c-8aea-238713004c76 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.815951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12aabe-9f2f-478c-8aea-238713004c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:23.816255 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12aabe-9f2f-478c-8aea-238713004c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:23.817625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae12aabe-9f2f-478c-8aea-238713004c76 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:23.835425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 287/582] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:23.835425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12aabe-9f2f-478c-8aea-238713004c76 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:23.865802 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:23.880406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761d498-7f65-499d-9d9c-d69a750d8769 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:23.914345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aac0a-282d-46a2-a14b-ac00b837dfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:23.915074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aac0a-282d-46a2-a14b-ac00b837dfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.915424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aac0a-282d-46a2-a14b-ac00b837dfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.916025 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7aac0a-282d-46a2-a14b-ac00b837dfc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.927523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7aac0a-282d-46a2-a14b-ac00b837dfc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-4f7aac0a-282d-46a2-a14b-ac00b837dfc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:23.933594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:23.934823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:23.935826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 296/583] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:23.936533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aac0a-282d-46a2-a14b-ac00b837dfc0 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:23.950412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12aabe-9f2f-478c-8aea-238713004c76 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:23.974446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:23.989298 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c987f9-4bcf-4e6b-9f7a-d65a8d676685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:23.989923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c987f9-4bcf-4e6b-9f7a-d65a8d676685 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:23.990316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c987f9-4bcf-4e6b-9f7a-d65a8d676685 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:23.990595 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c987f9-4bcf-4e6b-9f7a-d65a8d676685 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:23.991297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c987f9-4bcf-4e6b-9f7a-d65a8d676685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:23.991603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c987f9-4bcf-4e6b-9f7a-d65a8d676685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:23.993036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c987f9-4bcf-4e6b-9f7a-d65a8d676685 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:24.006872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 288/584] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:24.007713 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c987f9-4bcf-4e6b-9f7a-d65a8d676685 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:24.059159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7aac0a-282d-46a2-a14b-ac00b837dfc0 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:24.094659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9723f-8a34-48af-b6f8-f980c0b7eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:24.095312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9723f-8a34-48af-b6f8-f980c0b7eec2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:24.095588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9723f-8a34-48af-b6f8-f980c0b7eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:24.095859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9723f-8a34-48af-b6f8-f980c0b7eec2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:24.106038 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9723f-8a34-48af-b6f8-f980c0b7eec2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:24.107532 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9723f-8a34-48af-b6f8-f980c0b7eec2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:24.120915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c987f9-4bcf-4e6b-9f7a-d65a8d676685 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-96e9723f-8a34-48af-b6f8-f980c0b7eec2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:24.123088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:24.124183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:24.125679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:24.125679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:24.125679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:24.125679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:24.125679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:24.125679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:24.125679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:24.125679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:24.127000 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 297/585] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:24.127223 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9723f-8a34-48af-b6f8-f980c0b7eec2 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:24.145974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:24.169075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51875c16-048f-4d41-895d-55767fd1e264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:24.169733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51875c16-048f-4d41-895d-55767fd1e264 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:24.170043 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51875c16-048f-4d41-895d-55767fd1e264 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:24.170320 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51875c16-048f-4d41-895d-55767fd1e264 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:24.180779 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51875c16-048f-4d41-895d-55767fd1e264 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:24.182235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51875c16-048f-4d41-895d-55767fd1e264 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-51875c16-048f-4d41-895d-55767fd1e264 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:24.195139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:24.196131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:24.197063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:24.197063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:24.197063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:24.197063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:24.197063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:24.197063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:24.197063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:24.197063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:24.197063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:10:24.197063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:24.197063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 289/586] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:24.197669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51875c16-048f-4d41-895d-55767fd1e264 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:24.247742 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:24.248095 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9723f-8a34-48af-b6f8-f980c0b7eec2 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:24.288279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d0cd0-8ee3-43c2-a687-5dd2c3d45183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:24.289537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d0cd0-8ee3-43c2-a687-5dd2c3d45183 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:24.289817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d0cd0-8ee3-43c2-a687-5dd2c3d45183 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:24.290128 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d0cd0-8ee3-43c2-a687-5dd2c3d45183 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:24.291135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d0cd0-8ee3-43c2-a687-5dd2c3d45183 None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:24.291436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d0cd0-8ee3-43c2-a687-5dd2c3d45183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:24.292950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d0cd0-8ee3-43c2-a687-5dd2c3d45183 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:24.310092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 298/587] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:24.310092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d0cd0-8ee3-43c2-a687-5dd2c3d45183 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:24.323561 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51875c16-048f-4d41-895d-55767fd1e264 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:24.378061 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24bc9f-9dc1-476b-98ac-d32bdbb2e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:24.378721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24bc9f-9dc1-476b-98ac-d32bdbb2e564 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:24.378972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24bc9f-9dc1-476b-98ac-d32bdbb2e564 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:24.379244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24bc9f-9dc1-476b-98ac-d32bdbb2e564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:24.386090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24bc9f-9dc1-476b-98ac-d32bdbb2e564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:24.387520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d24bc9f-9dc1-476b-98ac-d32bdbb2e564 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:24.396429 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-3d24bc9f-9dc1-476b-98ac-d32bdbb2e564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:24.403481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:24.404576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:24.406272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:24.406272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:24.406272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:24.406272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:24.406272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:24.406272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:24.406272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:24.406272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:24.409904 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 290/588] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:24.410750 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24bc9f-9dc1-476b-98ac-d32bdbb2e564 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:24.427907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d0cd0-8ee3-43c2-a687-5dd2c3d45183 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:24.465560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d1f3e-a8f1-42cd-9dcd-3a5ae5f77555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:24.466265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d1f3e-a8f1-42cd-9dcd-3a5ae5f77555 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:24.466485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d1f3e-a8f1-42cd-9dcd-3a5ae5f77555 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:24.466741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d1f3e-a8f1-42cd-9dcd-3a5ae5f77555 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:24.467483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d1f3e-a8f1-42cd-9dcd-3a5ae5f77555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:24.467788 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d1f3e-a8f1-42cd-9dcd-3a5ae5f77555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:24.469718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d1f3e-a8f1-42cd-9dcd-3a5ae5f77555 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:24.489344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 299/589] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:24.489344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d1f3e-a8f1-42cd-9dcd-3a5ae5f77555 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:24.532239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24bc9f-9dc1-476b-98ac-d32bdbb2e564 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:24.534313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:24.573559 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1798054-706b-47f2-92b4-3f2087343565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:24.574219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1798054-706b-47f2-92b4-3f2087343565 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:24.574496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1798054-706b-47f2-92b4-3f2087343565 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:24.574777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1798054-706b-47f2-92b4-3f2087343565 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:24.575585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1798054-706b-47f2-92b4-3f2087343565 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:24.575892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1798054-706b-47f2-92b4-3f2087343565 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:24.577813 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1798054-706b-47f2-92b4-3f2087343565 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:24.597530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 291/590] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 08:10:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:24.598236 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1798054-706b-47f2-92b4-3f2087343565 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:24.606549 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d1f3e-a8f1-42cd-9dcd-3a5ae5f77555 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:24.644736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd15efa-6eba-4a6a-be53-c8d3885ab63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:24.645398 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd15efa-6eba-4a6a-be53-c8d3885ab63b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:24.645677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd15efa-6eba-4a6a-be53-c8d3885ab63b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:24.645942 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd15efa-6eba-4a6a-be53-c8d3885ab63b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:24.654198 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:24.658876 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd15efa-6eba-4a6a-be53-c8d3885ab63b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:24.660818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd15efa-6eba-4a6a-be53-c8d3885ab63b None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-5fd15efa-6eba-4a6a-be53-c8d3885ab63b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:24.678323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:24.679543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:24.680563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:24.680563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:24.680563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:24.680563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:24.680563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 300/591] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:24.681539 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd15efa-6eba-4a6a-be53-c8d3885ab63b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:24.710390 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1798054-706b-47f2-92b4-3f2087343565 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:24.747802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325b35c-92c0-4154-9d3b-8ef8ea9e976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:24.748632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325b35c-92c0-4154-9d3b-8ef8ea9e976f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:24.749024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325b35c-92c0-4154-9d3b-8ef8ea9e976f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:24.749398 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325b35c-92c0-4154-9d3b-8ef8ea9e976f None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:24.750407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325b35c-92c0-4154-9d3b-8ef8ea9e976f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:24.750827 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325b35c-92c0-4154-9d3b-8ef8ea9e976f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:24.752398 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325b35c-92c0-4154-9d3b-8ef8ea9e976f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:24.765766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 292/592] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:24.766637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325b35c-92c0-4154-9d3b-8ef8ea9e976f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:24.795275 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:24.810320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd15efa-6eba-4a6a-be53-c8d3885ab63b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:24.845893 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d028039-496f-4f07-9992-cd634a57070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:24.847519 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d028039-496f-4f07-9992-cd634a57070c None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:24.848301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d028039-496f-4f07-9992-cd634a57070c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:24.848787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d028039-496f-4f07-9992-cd634a57070c None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/93143507a8784a30bc6b4a5e1f24f0b6/roles/64801aebebf743e6b6a4201447a7fe0d` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:24.881297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d028039-496f-4f07-9992-cd634a57070c None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=93143507a8784a30bc6b4a5e1f24f0b6, role_id=64801aebebf743e6b6a4201447a7fe0d)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:24.881935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325b35c-92c0-4154-9d3b-8ef8ea9e976f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:24.885902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d028039-496f-4f07-9992-cd634a57070c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:24.909367 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 301/593] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:10:24 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/93143507a8784a30bc6b4a5e1f24f0b6/roles/64801aebebf743e6b6a4201447a7fe0d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:10:24.915988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d028039-496f-4f07-9992-cd634a57070c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:24.926045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b13a-0f00-45e6-8130-d0538cb4ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:24.926045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b13a-0f00-45e6-8130-d0538cb4ee6e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:24.926045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b13a-0f00-45e6-8130-d0538cb4ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:24.926045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b13a-0f00-45e6-8130-d0538cb4ee6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:24.934267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b13a-0f00-45e6-8130-d0538cb4ee6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:24.935982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b13a-0f00-45e6-8130-d0538cb4ee6e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-23c4b13a-0f00-45e6-8130-d0538cb4ee6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:24.954842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:24.956683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:24.958743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:24.958743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:24.958743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:24.958743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:24.966043 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 293/594] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:24.966043 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b13a-0f00-45e6-8130-d0538cb4ee6e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:24.992373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:25.053925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:25.080720 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d028039-496f-4f07-9992-cd634a57070c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:25.091170 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b13a-0f00-45e6-8130-d0538cb4ee6e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:25.123021 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd934cb2-310b-447c-bd70-8b26d8050766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:25.123916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd934cb2-310b-447c-bd70-8b26d8050766 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.123916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd934cb2-310b-447c-bd70-8b26d8050766 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.124217 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd934cb2-310b-447c-bd70-8b26d8050766 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.124977 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd934cb2-310b-447c-bd70-8b26d8050766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:25.125289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd934cb2-310b-447c-bd70-8b26d8050766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:25.126809 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd934cb2-310b-447c-bd70-8b26d8050766 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:25.139013 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 302/595] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:25.140024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd934cb2-310b-447c-bd70-8b26d8050766 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:25.141108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5d831-fba9-4b25-be46-0c01eeb886d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:25.141789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d831-fba9-4b25-be46-0c01eeb886d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.142176 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d831-fba9-4b25-be46-0c01eeb886d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.142458 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5d831-fba9-4b25-be46-0c01eeb886d4 None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/739b8f31f1d74459a7348c3ed699812c/roles/64801aebebf743e6b6a4201447a7fe0d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.161310 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5d831-fba9-4b25-be46-0c01eeb886d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=739b8f31f1d74459a7348c3ed699812c, role_id=64801aebebf743e6b6a4201447a7fe0d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:25.162785 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5d831-fba9-4b25-be46-0c01eeb886d4 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:25.176707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 294/596] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:10:24 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/739b8f31f1d74459a7348c3ed699812c/roles/64801aebebf743e6b6a4201447a7fe0d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:10:25.177737 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3bbf-5bc3-4be2-9bff-4e72a9553ecf None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.178041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3bbf-5bc3-4be2-9bff-4e72a9553ecf None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.178322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3bbf-5bc3-4be2-9bff-4e72a9553ecf None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.179797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 295/597] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:25.180453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd3bbf-5bc3-4be2-9bff-4e72a9553ecf None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:25.267139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:25.271353 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd934cb2-310b-447c-bd70-8b26d8050766 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:25.316037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6b690-b31a-4257-8299-b677c59aa0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:25.316604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6b690-b31a-4257-8299-b677c59aa0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.316884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6b690-b31a-4257-8299-b677c59aa0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.317163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6b690-b31a-4257-8299-b677c59aa0d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.318466 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6b690-b31a-4257-8299-b677c59aa0d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:25.319771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6b690-b31a-4257-8299-b677c59aa0d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:25.321686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6b690-b31a-4257-8299-b677c59aa0d2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:25.332868 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd3bbf-5bc3-4be2-9bff-4e72a9553ecf None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:25.341443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 303/598] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:25.343463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23b4c9-bcd6-4c6c-8f07-49f0d07aeaf6 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.343766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23b4c9-bcd6-4c6c-8f07-49f0d07aeaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.344040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23b4c9-bcd6-4c6c-8f07-49f0d07aeaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.367349 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:25.371432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-ef23b4c9-bcd6-4c6c-8f07-49f0d07aeaf6 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:25.373602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ef23b4c9-bcd6-4c6c-8f07-49f0d07aeaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:25.384794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47371f4c-ab79-49a7-9dd0-ce7829fdb177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:25.385469 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47371f4c-ab79-49a7-9dd0-ce7829fdb177 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.385717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47371f4c-ab79-49a7-9dd0-ce7829fdb177 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.385991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47371f4c-ab79-49a7-9dd0-ce7829fdb177 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.396095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47371f4c-ab79-49a7-9dd0-ce7829fdb177 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:25.398316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47371f4c-ab79-49a7-9dd0-ce7829fdb177 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-47371f4c-ab79-49a7-9dd0-ce7829fdb177 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:25.413854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:25.415035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:25.416521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:25.416521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:25.416521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:25.416521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:25.416521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:25.416521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:25.416521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:25.416521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:25.416521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:10:25.416521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:25.416521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 296/599] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:25.417223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47371f4c-ab79-49a7-9dd0-ce7829fdb177 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:25.466929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 304/600] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:25.468501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23b4c9-bcd6-4c6c-8f07-49f0d07aeaf6 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:25.543347 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47371f4c-ab79-49a7-9dd0-ce7829fdb177 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:25.566551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:25.575003 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23b4c9-bcd6-4c6c-8f07-49f0d07aeaf6 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:25.587868 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789b46a-2907-4f6d-b74e-9a5955f6b1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:25.589085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789b46a-2907-4f6d-b74e-9a5955f6b1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.589872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789b46a-2907-4f6d-b74e-9a5955f6b1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.590532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789b46a-2907-4f6d-b74e-9a5955f6b1d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.600230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789b46a-2907-4f6d-b74e-9a5955f6b1d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:25.602299 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789b46a-2907-4f6d-b74e-9a5955f6b1d0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:25.613902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb10ca-75b2-4cac-bebf-7f52550cf9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:25.614697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb10ca-75b2-4cac-bebf-7f52550cf9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.615079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb10ca-75b2-4cac-bebf-7f52550cf9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.615459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb10ca-75b2-4cac-bebf-7f52550cf9f3 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.616374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb10ca-75b2-4cac-bebf-7f52550cf9f3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:25.616787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb10ca-75b2-4cac-bebf-7f52550cf9f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-5789b46a-2907-4f6d-b74e-9a5955f6b1d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:25.617724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:25.618672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:25.619586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:25.619586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:25.619586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:25.619586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:25.619586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:25.619586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:25.619586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:25.619586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:25.620047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb10ca-75b2-4cac-bebf-7f52550cf9f3 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:25.626606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 297/601] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:25.627741 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789b46a-2907-4f6d-b74e-9a5955f6b1d0 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:25.640303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 305/602] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Aug 2 08:10:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:25.641484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb10ca-75b2-4cac-bebf-7f52550cf9f3 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:25.675240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:25.738929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789b46a-2907-4f6d-b74e-9a5955f6b1d0 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:25.757171 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb10ca-75b2-4cac-bebf-7f52550cf9f3 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:25.776006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd8d1-6464-4ee6-a973-322d4e196dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:25.776900 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd8d1-6464-4ee6-a973-322d4e196dad None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.777350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd8d1-6464-4ee6-a973-322d4e196dad None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.777769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd8d1-6464-4ee6-a973-322d4e196dad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.789220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bd8d1-6464-4ee6-a973-322d4e196dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-552bd8d1-6464-4ee6-a973-322d4e196dad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:25.795615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:25.796602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:25.797452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:25.798156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f8369-ece5-4605-bfa3-a0a29b66013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:25.798156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f8369-ece5-4605-bfa3-a0a29b66013d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.798156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f8369-ece5-4605-bfa3-a0a29b66013d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.798156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f8369-ece5-4605-bfa3-a0a29b66013d None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.798423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f8369-ece5-4605-bfa3-a0a29b66013d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:25.799020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f8369-ece5-4605-bfa3-a0a29b66013d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:25.800060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f8369-ece5-4605-bfa3-a0a29b66013d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:25.800928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 298/603] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:25.802039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd8d1-6464-4ee6-a973-322d4e196dad None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:25.818144 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 306/604] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:25.818144 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f8369-ece5-4605-bfa3-a0a29b66013d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:25.832487 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:25.917766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd8d1-6464-4ee6-a973-322d4e196dad None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:25.919671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:25.935293 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f8369-ece5-4605-bfa3-a0a29b66013d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:25.958445 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c69c9-181b-40d2-bafa-bfc24962fb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:25.959411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c69c9-181b-40d2-bafa-bfc24962fb3c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.959921 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c69c9-181b-40d2-bafa-bfc24962fb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.960372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c69c9-181b-40d2-bafa-bfc24962fb3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.972088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c69c9-181b-40d2-bafa-bfc24962fb3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:25.972955 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9250c2-8799-4842-836e-60154f3b1ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:25.973655 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9250c2-8799-4842-836e-60154f3b1ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:25.974024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9250c2-8799-4842-836e-60154f3b1ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:25.974383 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9250c2-8799-4842-836e-60154f3b1ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:25.974684 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c69c9-181b-40d2-bafa-bfc24962fb3c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:25.975268 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9250c2-8799-4842-836e-60154f3b1ab3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:25.975627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9250c2-8799-4842-836e-60154f3b1ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:25.977062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9250c2-8799-4842-836e-60154f3b1ab3 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:25.986359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 307/605] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:25.987282 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9250c2-8799-4842-836e-60154f3b1ab3 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-740c69c9-181b-40d2-bafa-bfc24962fb3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:25.992056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:25.992999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:25.993918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:25.993918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:25.993918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:25.993918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:25.996136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 299/606] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:25.997187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c69c9-181b-40d2-bafa-bfc24962fb3c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:26.063325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:26.098938 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9250c2-8799-4842-836e-60154f3b1ab3 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:26.107231 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c69c9-181b-40d2-bafa-bfc24962fb3c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:26.135378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95bf7f-0c47-4573-ad09-754f48e9730d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:26.136057 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95bf7f-0c47-4573-ad09-754f48e9730d None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:26.136339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95bf7f-0c47-4573-ad09-754f48e9730d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:26.136617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95bf7f-0c47-4573-ad09-754f48e9730d None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/6557be84abb6469d95157570517512fc/roles/64801aebebf743e6b6a4201447a7fe0d` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:26.146242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73918b59-374f-4299-8016-630b93b2b661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:26.147531 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73918b59-374f-4299-8016-630b93b2b661 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:26.148144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73918b59-374f-4299-8016-630b93b2b661 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:26.148652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73918b59-374f-4299-8016-630b93b2b661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:26.153144 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95bf7f-0c47-4573-ad09-754f48e9730d None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=6557be84abb6469d95157570517512fc, role_id=64801aebebf743e6b6a4201447a7fe0d)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:26.154672 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95bf7f-0c47-4573-ad09-754f48e9730d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:26.163451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73918b59-374f-4299-8016-630b93b2b661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:26.165575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73918b59-374f-4299-8016-630b93b2b661 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:26.182078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 308/607] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:10:25 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/6557be84abb6469d95157570517512fc/roles/64801aebebf743e6b6a4201447a7fe0d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:10:26.182078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95bf7f-0c47-4573-ad09-754f48e9730d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-73918b59-374f-4299-8016-630b93b2b661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:26.197660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:26.198662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:26.199643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:26.199643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:26.199643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:26.199643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:26.199643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 300/608] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:26.205173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73918b59-374f-4299-8016-630b93b2b661 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:26.220053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:26.325411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95bf7f-0c47-4573-ad09-754f48e9730d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:26.352244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:26.376657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c6186-5572-4a31-9bd1-c8bea08cdce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:26.378573 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c6186-5572-4a31-9bd1-c8bea08cdce2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:26.378860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c6186-5572-4a31-9bd1-c8bea08cdce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:26.379137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c6186-5572-4a31-9bd1-c8bea08cdce2 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:26.379854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c6186-5572-4a31-9bd1-c8bea08cdce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:26.380162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c6186-5572-4a31-9bd1-c8bea08cdce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:26.381561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c6186-5572-4a31-9bd1-c8bea08cdce2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:26.413798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 309/609] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:26.415055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73918b59-374f-4299-8016-630b93b2b661 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:26.423344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c6186-5572-4a31-9bd1-c8bea08cdce2 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:26.463583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e1444-1b60-4414-bc40-f34e715d4e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:26.463825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e1444-1b60-4414-bc40-f34e715d4e12 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:26.464061 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e1444-1b60-4414-bc40-f34e715d4e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:26.464345 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e1444-1b60-4414-bc40-f34e715d4e12 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:26.465727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e1444-1b60-4414-bc40-f34e715d4e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:26.466070 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e1444-1b60-4414-bc40-f34e715d4e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:26.467809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e1444-1b60-4414-bc40-f34e715d4e12 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:26.484787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 301/610] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:26.489972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e1444-1b60-4414-bc40-f34e715d4e12 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:26.555334 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c6186-5572-4a31-9bd1-c8bea08cdce2 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:26.569295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:26.598310 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb80eb-fe31-46d7-89db-0eea09fbcb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:26.599651 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb80eb-fe31-46d7-89db-0eea09fbcb56 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:26.600142 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb80eb-fe31-46d7-89db-0eea09fbcb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:26.600854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb80eb-fe31-46d7-89db-0eea09fbcb56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:26.617521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e1444-1b60-4414-bc40-f34e715d4e12 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:26.619578 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb80eb-fe31-46d7-89db-0eea09fbcb56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:26.621046 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb80eb-fe31-46d7-89db-0eea09fbcb56 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-24eb80eb-fe31-46d7-89db-0eea09fbcb56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:26.644857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:26.645863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:26.646811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:26.646811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:26.646811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:26.646811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:26.646811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:26.646811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:26.646811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:26.646811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:26.646811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 310/611] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:26.654973 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb80eb-fe31-46d7-89db-0eea09fbcb56 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:26.682833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4298ed3-e245-4010-baeb-e9c5a1e87a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:26.683905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298ed3-e245-4010-baeb-e9c5a1e87a22 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:26.684391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298ed3-e245-4010-baeb-e9c5a1e87a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:26.684858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4298ed3-e245-4010-baeb-e9c5a1e87a22 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:26.696203 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4298ed3-e245-4010-baeb-e9c5a1e87a22 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:26.699559 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4298ed3-e245-4010-baeb-e9c5a1e87a22 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-f4298ed3-e245-4010-baeb-e9c5a1e87a22 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:26.723874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:26.725003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:26.726359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:26.726359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:26.726359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:26.726359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:26.726359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:26.726359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:26.726359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:26.726359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:26.726359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:26.726359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:26.731282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 302/612] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:26.742800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4298ed3-e245-4010-baeb-e9c5a1e87a22 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:26.753649 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:26.861424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb80eb-fe31-46d7-89db-0eea09fbcb56 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:26.909068 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4298ed3-e245-4010-baeb-e9c5a1e87a22 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:26.938305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:26.944590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730781e5-c8ce-4067-96d2-d992a2e50bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:26.945415 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730781e5-c8ce-4067-96d2-d992a2e50bbf None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:26.945800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730781e5-c8ce-4067-96d2-d992a2e50bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:26.946185 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730781e5-c8ce-4067-96d2-d992a2e50bbf None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:26.947081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730781e5-c8ce-4067-96d2-d992a2e50bbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:26.947397 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730781e5-c8ce-4067-96d2-d992a2e50bbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:26.949311 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730781e5-c8ce-4067-96d2-d992a2e50bbf None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:26.950675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21945c-c56c-438e-8520-23496c4f624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:26.951625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21945c-c56c-438e-8520-23496c4f624f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:26.952090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21945c-c56c-438e-8520-23496c4f624f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:26.953157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21945c-c56c-438e-8520-23496c4f624f None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:26.954218 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21945c-c56c-438e-8520-23496c4f624f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:26.954722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21945c-c56c-438e-8520-23496c4f624f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:26.956309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21945c-c56c-438e-8520-23496c4f624f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:26.976908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 303/613] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 08:10:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:26.980538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 311/614] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:26.982236 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21945c-c56c-438e-8520-23496c4f624f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:26.986935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730781e5-c8ce-4067-96d2-d992a2e50bbf None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:27.153798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:27.162377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730781e5-c8ce-4067-96d2-d992a2e50bbf None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:27.164609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21945c-c56c-438e-8520-23496c4f624f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:27.201267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba1d6e-f7a5-448b-b83c-ea15d5bfaefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:27.202029 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba1d6e-f7a5-448b-b83c-ea15d5bfaefb None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:27.202956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba1d6e-f7a5-448b-b83c-ea15d5bfaefb None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:27.203308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba1d6e-f7a5-448b-b83c-ea15d5bfaefb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:27.215916 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba1d6e-f7a5-448b-b83c-ea15d5bfaefb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:27.217571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba1d6e-f7a5-448b-b83c-ea15d5bfaefb None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-75ba1d6e-f7a5-448b-b83c-ea15d5bfaefb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:27.234861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:27.235823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:27.236743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:27.236743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:27.236743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:27.236743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:27.236743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 304/615] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:27.243752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fa58a-9106-41f8-8f1f-2790675761f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:27.244275 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba1d6e-f7a5-448b-b83c-ea15d5bfaefb None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:27.244472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fa58a-9106-41f8-8f1f-2790675761f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:27.244724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fa58a-9106-41f8-8f1f-2790675761f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:27.244998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fa58a-9106-41f8-8f1f-2790675761f7 None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/e68c134016414ea5b851bde233ed9951/roles/64801aebebf743e6b6a4201447a7fe0d` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:27.262951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fa58a-9106-41f8-8f1f-2790675761f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=e68c134016414ea5b851bde233ed9951, role_id=64801aebebf743e6b6a4201447a7fe0d)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:27.264373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fa58a-9106-41f8-8f1f-2790675761f7 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:27.282159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 312/616] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:10:26 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/e68c134016414ea5b851bde233ed9951/roles/64801aebebf743e6b6a4201447a7fe0d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:10:27.284250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2871e-6188-4613-a3cc-3ee50ca95fe4 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:27.284678 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2871e-6188-4613-a3cc-3ee50ca95fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:27.285114 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2871e-6188-4613-a3cc-3ee50ca95fe4 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:27.287579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 313/617] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:27.292915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888bf2-38f8-40bf-90c4-5065415b949a None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:27.293251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888bf2-38f8-40bf-90c4-5065415b949a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:27.293542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888bf2-38f8-40bf-90c4-5065415b949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:27.298948 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:27.317432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-7b888bf2-38f8-40bf-90c4-5065415b949a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:27.318751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7b888bf2-38f8-40bf-90c4-5065415b949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:27.434507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 314/618] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:10:27.463315 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888bf2-38f8-40bf-90c4-5065415b949a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:27.466988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba1d6e-f7a5-448b-b83c-ea15d5bfaefb None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:27.529086 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acd328-3412-4d96-8a27-237e8b43092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:27.529995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acd328-3412-4d96-8a27-237e8b43092b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:27.530460 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acd328-3412-4d96-8a27-237e8b43092b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:27.530885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acd328-3412-4d96-8a27-237e8b43092b None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:27.532333 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acd328-3412-4d96-8a27-237e8b43092b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:27.532811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acd328-3412-4d96-8a27-237e8b43092b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:27.534690 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acd328-3412-4d96-8a27-237e8b43092b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:27.554209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 305/619] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:27.555559 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f8326-156c-4d5a-8ae3-6cfd7904aa9e None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:27.555957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f8326-156c-4d5a-8ae3-6cfd7904aa9e None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:27.556330 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f8326-156c-4d5a-8ae3-6cfd7904aa9e None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:27.557962 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 306/620] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:27.563282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f8326-156c-4d5a-8ae3-6cfd7904aa9e None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:27.566612 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:27.587278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888bf2-38f8-40bf-90c4-5065415b949a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:27.625648 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85162c16-fdeb-4437-ba40-8fb34365457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:27.626622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162c16-fdeb-4437-ba40-8fb34365457c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:27.627344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162c16-fdeb-4437-ba40-8fb34365457c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:27.627780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162c16-fdeb-4437-ba40-8fb34365457c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:27.641501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85162c16-fdeb-4437-ba40-8fb34365457c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-85162c16-fdeb-4437-ba40-8fb34365457c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:27.648637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:27.649952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:27.651029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:27.654454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 315/621] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:27.656026 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f0d9-d569-4e27-880d-68e649fe01bf None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:27.656475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f0d9-d569-4e27-880d-68e649fe01bf None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:27.656896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f0d9-d569-4e27-880d-68e649fe01bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:27.681094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-42e1f0d9-d569-4e27-880d-68e649fe01bf None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:27.683070 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-42e1f0d9-d569-4e27-880d-68e649fe01bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:27.691563 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f8326-156c-4d5a-8ae3-6cfd7904aa9e None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:27.700471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:27.731099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7feb5-816b-4d0a-a11c-cb05e37c8d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:27.732074 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7feb5-816b-4d0a-a11c-cb05e37c8d1a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:27.733315 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7feb5-816b-4d0a-a11c-cb05e37c8d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:27.734260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7feb5-816b-4d0a-a11c-cb05e37c8d1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:27.742476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7feb5-816b-4d0a-a11c-cb05e37c8d1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:27.744769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7feb5-816b-4d0a-a11c-cb05e37c8d1a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-a7e7feb5-816b-4d0a-a11c-cb05e37c8d1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:27.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:27.761810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:27.762943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:27.762943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:27.762943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:27.762943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:27.762943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:27.762943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:27.762943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:27.762943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:27.764756 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 307/622] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:27.765965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7feb5-816b-4d0a-a11c-cb05e37c8d1a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:27.771720 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 316/623] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:27.772758 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f0d9-d569-4e27-880d-68e649fe01bf None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:27.886375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:27.904756 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7feb5-816b-4d0a-a11c-cb05e37c8d1a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:27.928915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f0d9-d569-4e27-880d-68e649fe01bf None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:27.949458 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410254ff-2c2e-4443-b9df-3a4c308562dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:27.950657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410254ff-2c2e-4443-b9df-3a4c308562dd None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:27.951441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410254ff-2c2e-4443-b9df-3a4c308562dd None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:27.951919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410254ff-2c2e-4443-b9df-3a4c308562dd None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:27.952947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410254ff-2c2e-4443-b9df-3a4c308562dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:27.953435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410254ff-2c2e-4443-b9df-3a4c308562dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:27.955896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410254ff-2c2e-4443-b9df-3a4c308562dd None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:27.968376 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 308/624] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:27.969528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410254ff-2c2e-4443-b9df-3a4c308562dd None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:27.971330 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e81a1-c05e-44f7-a107-63e2834580ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:27.972036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e81a1-c05e-44f7-a107-63e2834580ae None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:27.972389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e81a1-c05e-44f7-a107-63e2834580ae None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:27.972802 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e81a1-c05e-44f7-a107-63e2834580ae None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:27.973889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e81a1-c05e-44f7-a107-63e2834580ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:27.974298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e81a1-c05e-44f7-a107-63e2834580ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:27.976645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e81a1-c05e-44f7-a107-63e2834580ae None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:27.994036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 317/625] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:27.994996 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e81a1-c05e-44f7-a107-63e2834580ae None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:27.995223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:28.103530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410254ff-2c2e-4443-b9df-3a4c308562dd None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:28.128651 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e81a1-c05e-44f7-a107-63e2834580ae None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:28.151720 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3eaa1e-8856-4d76-b9a6-4ccee5e8854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:28.154546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eaa1e-8856-4d76-b9a6-4ccee5e8854c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:28.154546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eaa1e-8856-4d76-b9a6-4ccee5e8854c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:28.154546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3eaa1e-8856-4d76-b9a6-4ccee5e8854c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:28.164600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:28.169155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3eaa1e-8856-4d76-b9a6-4ccee5e8854c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-7e3eaa1e-8856-4d76-b9a6-4ccee5e8854c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:28.176795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:28.177744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:28.178663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:28.179319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b21429-c732-4e44-8763-45e700a74c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:28.179319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b21429-c732-4e44-8763-45e700a74c3c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:28.179319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b21429-c732-4e44-8763-45e700a74c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:28.179319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b21429-c732-4e44-8763-45e700a74c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:28.181100 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 309/626] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:28.182081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3eaa1e-8856-4d76-b9a6-4ccee5e8854c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:28.201115 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b21429-c732-4e44-8763-45e700a74c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:28.203029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b21429-c732-4e44-8763-45e700a74c3c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-67b21429-c732-4e44-8763-45e700a74c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:28.224500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:28.225625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:28.226591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:28.226591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:28.226591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:28.226591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:28.226591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 318/627] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:28.227005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b21429-c732-4e44-8763-45e700a74c3c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:28.281262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:28.312996 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3eaa1e-8856-4d76-b9a6-4ccee5e8854c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:28.355379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b21429-c732-4e44-8763-45e700a74c3c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:28.365244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c48cc-658f-4cd0-a069-deedcbd47634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:28.366225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c48cc-658f-4cd0-a069-deedcbd47634 None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:28.367438 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c48cc-658f-4cd0-a069-deedcbd47634 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:28.367949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c48cc-658f-4cd0-a069-deedcbd47634 None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/e02b653d2f5e4faca2906b2fbd1bfc5c/roles/64801aebebf743e6b6a4201447a7fe0d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:28.389249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c48cc-658f-4cd0-a069-deedcbd47634 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=e02b653d2f5e4faca2906b2fbd1bfc5c, role_id=64801aebebf743e6b6a4201447a7fe0d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:28.392063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c48cc-658f-4cd0-a069-deedcbd47634 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:28.397468 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1f9b-12ac-4f3a-8a21-59e806077b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:28.398288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1f9b-12ac-4f3a-8a21-59e806077b6c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:28.398647 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1f9b-12ac-4f3a-8a21-59e806077b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:28.399060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1f9b-12ac-4f3a-8a21-59e806077b6c None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:28.399894 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf1f9b-12ac-4f3a-8a21-59e806077b6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:28.400378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf1f9b-12ac-4f3a-8a21-59e806077b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:28.401925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf1f9b-12ac-4f3a-8a21-59e806077b6c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:28.411622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 310/628] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:10:28 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/e02b653d2f5e4faca2906b2fbd1bfc5c/roles/64801aebebf743e6b6a4201447a7fe0d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:10:28.417371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c48cc-658f-4cd0-a069-deedcbd47634 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:28.417585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 319/629] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:28.419535 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1f9b-12ac-4f3a-8a21-59e806077b6c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:28.477911 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:28.555298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1f9b-12ac-4f3a-8a21-59e806077b6c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:28.556591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c48cc-658f-4cd0-a069-deedcbd47634 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:28.596599 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:28.610925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d751-7345-4977-a437-549c1c692dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:28.611825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d751-7345-4977-a437-549c1c692dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:28.612108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d751-7345-4977-a437-549c1c692dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:28.612384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570d751-7345-4977-a437-549c1c692dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:28.618638 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c649b76-4011-42c6-9972-8e202e92aa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:28.619285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c649b76-4011-42c6-9972-8e202e92aa85 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:28.619567 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c649b76-4011-42c6-9972-8e202e92aa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:28.619829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c649b76-4011-42c6-9972-8e202e92aa85 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:28.620541 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c649b76-4011-42c6-9972-8e202e92aa85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:28.620846 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c649b76-4011-42c6-9972-8e202e92aa85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:28.624612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c649b76-4011-42c6-9972-8e202e92aa85 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:28.640771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570d751-7345-4977-a437-549c1c692dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:28.642943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570d751-7345-4977-a437-549c1c692dd8 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:28.651207 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 311/630] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:28.657859 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c649b76-4011-42c6-9972-8e202e92aa85 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-d570d751-7345-4977-a437-549c1c692dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:28.664540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:28.665508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:28.671612 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:28.671612 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:28.671612 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:28.671612 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:28.671612 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 320/631] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:28.672167 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d751-7345-4977-a437-549c1c692dd8 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:28.800461 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c649b76-4011-42c6-9972-8e202e92aa85 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:28.841169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa698e6-c834-46bd-ace2-71e4c3b67118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:28.841937 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa698e6-c834-46bd-ace2-71e4c3b67118 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:28.842252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa698e6-c834-46bd-ace2-71e4c3b67118 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:28.842569 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa698e6-c834-46bd-ace2-71e4c3b67118 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:28.845321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:28.852697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570d751-7345-4977-a437-549c1c692dd8 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:28.855219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa698e6-c834-46bd-ace2-71e4c3b67118 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:28.857012 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa698e6-c834-46bd-ace2-71e4c3b67118 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-0aa698e6-c834-46bd-ace2-71e4c3b67118 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:28.870135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:28.871331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:28.872517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:28.872517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:28.872517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:28.872517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:28.872517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:28.872517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:28.872517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:28.872517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:28.872517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:28.872517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:28.875514 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 312/632] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 08:10:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:28.882597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07804978-d66c-4d81-a474-c2e31db3c491 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:28.882597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07804978-d66c-4d81-a474-c2e31db3c491 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:28.882597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07804978-d66c-4d81-a474-c2e31db3c491 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:28.882597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 313/633] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:28.888141 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90270d-5654-43f8-9eb0-fe582158dc41 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:28.888421 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90270d-5654-43f8-9eb0-fe582158dc41 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:28.888693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90270d-5654-43f8-9eb0-fe582158dc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:28.907038 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2612e-e52e-4499-a0e6-0380e1e53c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:28.907672 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2612e-e52e-4499-a0e6-0380e1e53c25 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:28.907956 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2612e-e52e-4499-a0e6-0380e1e53c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:28.908231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2612e-e52e-4499-a0e6-0380e1e53c25 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:28.908935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2612e-e52e-4499-a0e6-0380e1e53c25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:28.909242 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2612e-e52e-4499-a0e6-0380e1e53c25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:28.910656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2612e-e52e-4499-a0e6-0380e1e53c25 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:28.921983 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3c90270d-5654-43f8-9eb0-fe582158dc41 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:28.924639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3c90270d-5654-43f8-9eb0-fe582158dc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:28.926360 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 321/634] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:28.927292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2612e-e52e-4499-a0e6-0380e1e53c25 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:28.987006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:29.029263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 314/635] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:29.030787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90270d-5654-43f8-9eb0-fe582158dc41 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:29.090496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2612e-e52e-4499-a0e6-0380e1e53c25 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:29.142696 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fcf7a-f66f-4e36-8cf0-42d499851dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:29.143331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fcf7a-f66f-4e36-8cf0-42d499851dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:29.143614 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fcf7a-f66f-4e36-8cf0-42d499851dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:29.143892 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fcf7a-f66f-4e36-8cf0-42d499851dd8 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:29.144705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fcf7a-f66f-4e36-8cf0-42d499851dd8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:29.145054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fcf7a-f66f-4e36-8cf0-42d499851dd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:29.147307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fcf7a-f66f-4e36-8cf0-42d499851dd8 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:29.178053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 322/636] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 08:10:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:29.178053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fcf7a-f66f-4e36-8cf0-42d499851dd8 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:29.196028 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:29.201085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90270d-5654-43f8-9eb0-fe582158dc41 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:29.253011 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3d933-60f9-4d61-87e5-ad261b4d8010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:29.254959 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3d933-60f9-4d61-87e5-ad261b4d8010 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:29.255826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3d933-60f9-4d61-87e5-ad261b4d8010 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:29.256612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3d933-60f9-4d61-87e5-ad261b4d8010 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:29.273106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3d933-60f9-4d61-87e5-ad261b4d8010 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:29.275779 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3d933-60f9-4d61-87e5-ad261b4d8010 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:29.308872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fcf7a-f66f-4e36-8cf0-42d499851dd8 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-aca3d933-60f9-4d61-87e5-ad261b4d8010 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:29.310339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:29.312506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:29.314215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:29.314215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:29.314215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:29.314215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:29.314215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:29.314215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:29.314215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:29.314215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:29.314215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 08:10:29.314215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:29.315884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 315/637] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:29.318130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3d933-60f9-4d61-87e5-ad261b4d8010 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:29.374890 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1fb46-b342-4eb1-8bb7-195008be5206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:29.375613 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1fb46-b342-4eb1-8bb7-195008be5206 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:29.375894 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1fb46-b342-4eb1-8bb7-195008be5206 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:29.376231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1fb46-b342-4eb1-8bb7-195008be5206 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:29.395222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1fb46-b342-4eb1-8bb7-195008be5206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-5be1fb46-b342-4eb1-8bb7-195008be5206 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:29.400687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:29.401708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 323/638] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:29.402639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1fb46-b342-4eb1-8bb7-195008be5206 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:29.417471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:29.507316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:29.533970 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3d933-60f9-4d61-87e5-ad261b4d8010 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:29.547234 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1fb46-b342-4eb1-8bb7-195008be5206 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:29.604219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f60ec-48ca-4705-b819-150334c9be79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:29.605042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f60ec-48ca-4705-b819-150334c9be79 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:29.605174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f60ec-48ca-4705-b819-150334c9be79 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:29.605563 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f60ec-48ca-4705-b819-150334c9be79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:29.618902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc3ab0-90fd-4334-b319-1a5d220f1f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:29.619739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc3ab0-90fd-4334-b319-1a5d220f1f06 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:29.619739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc3ab0-90fd-4334-b319-1a5d220f1f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:29.620025 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc3ab0-90fd-4334-b319-1a5d220f1f06 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:29.620771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc3ab0-90fd-4334-b319-1a5d220f1f06 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:29.621083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc3ab0-90fd-4334-b319-1a5d220f1f06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:29.622698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc3ab0-90fd-4334-b319-1a5d220f1f06 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:29.647558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 324/639] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 08:10:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:29.648570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc3ab0-90fd-4334-b319-1a5d220f1f06 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:29.749472 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f60ec-48ca-4705-b819-150334c9be79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:29.752070 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f60ec-48ca-4705-b819-150334c9be79 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:29.818306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:29.834721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc3ab0-90fd-4334-b319-1a5d220f1f06 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:29.881481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:29.887803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2293a-7c89-45f6-8b2d-14a0220bc9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:29.888569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2293a-7c89-45f6-8b2d-14a0220bc9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:29.888925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2293a-7c89-45f6-8b2d-14a0220bc9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:29.889299 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2293a-7c89-45f6-8b2d-14a0220bc9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:29.890256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2293a-7c89-45f6-8b2d-14a0220bc9d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:29.890620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2293a-7c89-45f6-8b2d-14a0220bc9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:29.892389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2293a-7c89-45f6-8b2d-14a0220bc9d3 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:29.906711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 316/640] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:29.906711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cec119-1306-44bc-b0b8-ca97c8456041 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:29.906711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cec119-1306-44bc-b0b8-ca97c8456041 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:29.906711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cec119-1306-44bc-b0b8-ca97c8456041 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:29.906711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 317/641] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:29.906711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cec119-1306-44bc-b0b8-ca97c8456041 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:29.911681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 325/642] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:29.911681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2293a-7c89-45f6-8b2d-14a0220bc9d3 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:30.043681 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cec119-1306-44bc-b0b8-ca97c8456041 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:30.052470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2293a-7c89-45f6-8b2d-14a0220bc9d3 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:30.100700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd98c10-eb68-49b6-a59b-81646f2a5296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:30.101403 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98c10-eb68-49b6-a59b-81646f2a5296 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:30.101706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98c10-eb68-49b6-a59b-81646f2a5296 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:30.101955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98c10-eb68-49b6-a59b-81646f2a5296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:30.104849 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f4db-a550-4158-85d7-163b98d59e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:30.105970 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f4db-a550-4158-85d7-163b98d59e63 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:30.106529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f4db-a550-4158-85d7-163b98d59e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:30.107034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f4db-a550-4158-85d7-163b98d59e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:30.115283 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:30.133259 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55f4db-a550-4158-85d7-163b98d59e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:30.136379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55f4db-a550-4158-85d7-163b98d59e63 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-4c55f4db-a550-4158-85d7-163b98d59e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:30.169252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:30.170547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:30.172307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:30.172307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:30.172307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:30.172307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:30.179489 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 326/643] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:30.179489 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f4db-a550-4158-85d7-163b98d59e63 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:30.214053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd98c10-eb68-49b6-a59b-81646f2a5296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:30.215507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd98c10-eb68-49b6-a59b-81646f2a5296 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:30.239458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:30.315635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f4db-a550-4158-85d7-163b98d59e63 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:30.363868 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f24bd-4a9a-46bf-b0c4-29929b3a05ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:30.364533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f24bd-4a9a-46bf-b0c4-29929b3a05ee None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:30.364816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f24bd-4a9a-46bf-b0c4-29929b3a05ee None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:30.365190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f24bd-4a9a-46bf-b0c4-29929b3a05ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:30.374873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 318/644] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:30.374873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c98a1-6cf8-45dd-9324-83fa125572e3 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:30.374873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c98a1-6cf8-45dd-9324-83fa125572e3 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:30.374873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c98a1-6cf8-45dd-9324-83fa125572e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:30.399958 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f24bd-4a9a-46bf-b0c4-29929b3a05ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:30.401298 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-a25c98a1-6cf8-45dd-9324-83fa125572e3 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:30.401770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f24bd-4a9a-46bf-b0c4-29929b3a05ee None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:30.402983 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-a25c98a1-6cf8-45dd-9324-83fa125572e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-e75f24bd-4a9a-46bf-b0c4-29929b3a05ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:30.423645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:30.425307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:30.427138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:30.427138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:30.427138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:30.427138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:30.427138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 327/645] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:30.427138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f24bd-4a9a-46bf-b0c4-29929b3a05ee None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:30.454451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:30.510075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 319/646] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:30.510950 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c98a1-6cf8-45dd-9324-83fa125572e3 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:30.576611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:30.585127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f24bd-4a9a-46bf-b0c4-29929b3a05ee None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:30.630780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3f68-45c6-485d-bc98-750c5bd869d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:30.631519 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3f68-45c6-485d-bc98-750c5bd869d5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:30.631700 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3f68-45c6-485d-bc98-750c5bd869d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:30.631830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3f68-45c6-485d-bc98-750c5bd869d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:30.632538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c3f68-45c6-485d-bc98-750c5bd869d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:30.632845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c3f68-45c6-485d-bc98-750c5bd869d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:30.634241 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c3f68-45c6-485d-bc98-750c5bd869d5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:30.641536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c98a1-6cf8-45dd-9324-83fa125572e3 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:30.653929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 328/647] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:30.653929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3f68-45c6-485d-bc98-750c5bd869d5 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:30.695257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bd410-9bb4-4564-9c86-378ba5bc9919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:30.696142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bd410-9bb4-4564-9c86-378ba5bc9919 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:30.696426 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bd410-9bb4-4564-9c86-378ba5bc9919 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:30.696758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bd410-9bb4-4564-9c86-378ba5bc9919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:30.716935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bd410-9bb4-4564-9c86-378ba5bc9919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:30.720630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bd410-9bb4-4564-9c86-378ba5bc9919 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-892bd410-9bb4-4564-9c86-378ba5bc9919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:30.754693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:30.757520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:30.760812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:30.760812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:30.760812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:30.760812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:30.765078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 320/648] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:30.766866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bd410-9bb4-4564-9c86-378ba5bc9919 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:30.799047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:30.809562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3f68-45c6-485d-bc98-750c5bd869d5 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:30.868368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605b45e-b0f0-4b50-9ec0-d1536d54f1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:30.869435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605b45e-b0f0-4b50-9ec0-d1536d54f1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:30.869931 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605b45e-b0f0-4b50-9ec0-d1536d54f1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:30.870477 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605b45e-b0f0-4b50-9ec0-d1536d54f1f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:30.871761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605b45e-b0f0-4b50-9ec0-d1536d54f1f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:30.872319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605b45e-b0f0-4b50-9ec0-d1536d54f1f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:30.875007 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605b45e-b0f0-4b50-9ec0-d1536d54f1f7 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:30.895175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 329/649] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:30.896079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605b45e-b0f0-4b50-9ec0-d1536d54f1f7 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:30.921499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bd410-9bb4-4564-9c86-378ba5bc9919 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:30.922794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:30.971499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2340d0-9f9c-4fd5-97b7-df342234e846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:30.972137 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2340d0-9f9c-4fd5-97b7-df342234e846 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:30.972418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2340d0-9f9c-4fd5-97b7-df342234e846 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:30.972687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2340d0-9f9c-4fd5-97b7-df342234e846 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:30.982880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2340d0-9f9c-4fd5-97b7-df342234e846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-de2340d0-9f9c-4fd5-97b7-df342234e846 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:30.988261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:30.989343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 321/650] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:30.990382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2340d0-9f9c-4fd5-97b7-df342234e846 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:31.028155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605b45e-b0f0-4b50-9ec0-d1536d54f1f7 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:31.068992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01830f9-9d27-4faf-87b9-035b5c1f5cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:31.069633 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01830f9-9d27-4faf-87b9-035b5c1f5cbb None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:31.069950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01830f9-9d27-4faf-87b9-035b5c1f5cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:31.070226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01830f9-9d27-4faf-87b9-035b5c1f5cbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:31.077342 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01830f9-9d27-4faf-87b9-035b5c1f5cbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:31.079372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01830f9-9d27-4faf-87b9-035b5c1f5cbb None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:31.091197 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-d01830f9-9d27-4faf-87b9-035b5c1f5cbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:31.091491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:31.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:31.093837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:31.093837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:31.093837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:31.093837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:31.093837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:31.093837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:31.093837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:31.093837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:31.096773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 330/651] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:31.097639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01830f9-9d27-4faf-87b9-035b5c1f5cbb None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:31.114920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2340d0-9f9c-4fd5-97b7-df342234e846 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:31.153608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d81c40-e974-4684-9702-a34cf0c6748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:31.154410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d81c40-e974-4684-9702-a34cf0c6748a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:31.154634 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d81c40-e974-4684-9702-a34cf0c6748a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:31.154905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d81c40-e974-4684-9702-a34cf0c6748a None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:31.155648 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d81c40-e974-4684-9702-a34cf0c6748a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:31.155954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d81c40-e974-4684-9702-a34cf0c6748a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:31.157423 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d81c40-e974-4684-9702-a34cf0c6748a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:31.171191 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 322/652] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:31.172625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb4a07-6b7a-4b5e-a97a-c76e0a748b88 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:31.172860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb4a07-6b7a-4b5e-a97a-c76e0a748b88 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:31.173138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb4a07-6b7a-4b5e-a97a-c76e0a748b88 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:31.174607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 323/653] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:31.175388 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb4a07-6b7a-4b5e-a97a-c76e0a748b88 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:31.197718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:31.221349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01830f9-9d27-4faf-87b9-035b5c1f5cbb None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:31.258721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39976-8247-45cb-98d4-7f55d390fae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:31.259760 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39976-8247-45cb-98d4-7f55d390fae9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:31.260227 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39976-8247-45cb-98d4-7f55d390fae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:31.260709 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39976-8247-45cb-98d4-7f55d390fae9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:31.269993 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e39976-8247-45cb-98d4-7f55d390fae9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:31.271473 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e39976-8247-45cb-98d4-7f55d390fae9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-92e39976-8247-45cb-98d4-7f55d390fae9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:31.283520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:31.289516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 331/654] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:31.291054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39976-8247-45cb-98d4-7f55d390fae9 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:31.299837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb4a07-6b7a-4b5e-a97a-c76e0a748b88 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:31.350508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9351-c91a-4064-852f-72afe140ba89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:31.351503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9351-c91a-4064-852f-72afe140ba89 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:31.351956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9351-c91a-4064-852f-72afe140ba89 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:31.352279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb9351-c91a-4064-852f-72afe140ba89 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:31.353490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9351-c91a-4064-852f-72afe140ba89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:31.354031 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9351-c91a-4064-852f-72afe140ba89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:31.356117 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb9351-c91a-4064-852f-72afe140ba89 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:31.368077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 324/655] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:31.369466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9351-c91a-4064-852f-72afe140ba89 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:31.374615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:31.418344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39976-8247-45cb-98d4-7f55d390fae9 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:31.463741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f9767-bee6-4842-a71b-dee09ada7a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:31.464431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9767-bee6-4842-a71b-dee09ada7a64 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:31.464748 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9767-bee6-4842-a71b-dee09ada7a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:31.465026 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9767-bee6-4842-a71b-dee09ada7a64 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:31.465875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f9767-bee6-4842-a71b-dee09ada7a64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:31.466210 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f9767-bee6-4842-a71b-dee09ada7a64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:31.467787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f9767-bee6-4842-a71b-dee09ada7a64 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:31.480556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:31.488492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 332/656] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:31.490045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9b84a-487b-42bf-b8fd-6cd1d3f020fe None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:31.490601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9b84a-487b-42bf-b8fd-6cd1d3f020fe None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:31.490966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9b84a-487b-42bf-b8fd-6cd1d3f020fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:31.504835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb9351-c91a-4064-852f-72afe140ba89 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:31.517999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-6bd9b84a-487b-42bf-b8fd-6cd1d3f020fe None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:31.519803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-6bd9b84a-487b-42bf-b8fd-6cd1d3f020fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:31.540305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d408-715a-4cab-af70-a7b3d07cf8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:31.541227 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d408-715a-4cab-af70-a7b3d07cf8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:31.541500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d408-715a-4cab-af70-a7b3d07cf8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:31.541768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1d408-715a-4cab-af70-a7b3d07cf8c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:31.550199 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1d408-715a-4cab-af70-a7b3d07cf8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:31.551697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1d408-715a-4cab-af70-a7b3d07cf8c5 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-a0f1d408-715a-4cab-af70-a7b3d07cf8c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:31.564701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:31.566409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:31.567915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:31.567915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:31.567915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:31.567915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:31.567915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:31.567915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:31.567915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:31.567915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:31.569267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 325/657] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:31.570740 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d408-715a-4cab-af70-a7b3d07cf8c5 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:31.620735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 333/658] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:31.621904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9b84a-487b-42bf-b8fd-6cd1d3f020fe None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:31.656660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:31.706411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1d408-715a-4cab-af70-a7b3d07cf8c5 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:31.752051 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172ebfb-d80f-4113-ba00-d4cdf4aba752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:31.752606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172ebfb-d80f-4113-ba00-d4cdf4aba752 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:31.753207 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172ebfb-d80f-4113-ba00-d4cdf4aba752 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:31.753325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172ebfb-d80f-4113-ba00-d4cdf4aba752 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:31.754321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172ebfb-d80f-4113-ba00-d4cdf4aba752 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:31.754635 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172ebfb-d80f-4113-ba00-d4cdf4aba752 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:31.755211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9b84a-487b-42bf-b8fd-6cd1d3f020fe None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:31.756554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d172ebfb-d80f-4113-ba00-d4cdf4aba752 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:31.778277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 326/659] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 08:10:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:31.779138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172ebfb-d80f-4113-ba00-d4cdf4aba752 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:31.791967 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:31.808390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2e999-6b6e-455c-8fb1-a012b37fbb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:31.809084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2e999-6b6e-455c-8fb1-a012b37fbb13 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:31.809405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2e999-6b6e-455c-8fb1-a012b37fbb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:31.809687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2e999-6b6e-455c-8fb1-a012b37fbb13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:31.824393 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2e999-6b6e-455c-8fb1-a012b37fbb13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:31.827454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2e999-6b6e-455c-8fb1-a012b37fbb13 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-d4f2e999-6b6e-455c-8fb1-a012b37fbb13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:31.859529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:31.860589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:31.861486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:31.861486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:31.861486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:31.861486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:31.861709 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 334/660] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:31.862888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2e999-6b6e-455c-8fb1-a012b37fbb13 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:31.935092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172ebfb-d80f-4113-ba00-d4cdf4aba752 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:31.968842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:31.991144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c3f11-b2f6-4082-9f14-53fca3cb5d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:31.992132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c3f11-b2f6-4082-9f14-53fca3cb5d59 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:31.993154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c3f11-b2f6-4082-9f14-53fca3cb5d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:31.993639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c3f11-b2f6-4082-9f14-53fca3cb5d59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:31.995119 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c3f11-b2f6-4082-9f14-53fca3cb5d59 None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=93143507a8784a30bc6b4a5e1f24f0b6) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:31.995651 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c3f11-b2f6-4082-9f14-53fca3cb5d59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:31.998682 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c3f11-b2f6-4082-9f14-53fca3cb5d59 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:32.009098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 327/661] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:31 2022] GET /identity/v3/role_assignments?user.id=93143507a8784a30bc6b4a5e1f24f0b6&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:32.010397 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c3f11-b2f6-4082-9f14-53fca3cb5d59 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:32.043834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2e999-6b6e-455c-8fb1-a012b37fbb13 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:32.097293 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f76913-ac3e-4903-bf0f-4ee43047e172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:32.098337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76913-ac3e-4903-bf0f-4ee43047e172 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:32.098696 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76913-ac3e-4903-bf0f-4ee43047e172 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:32.099155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76913-ac3e-4903-bf0f-4ee43047e172 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:32.100553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f76913-ac3e-4903-bf0f-4ee43047e172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:32.101036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f76913-ac3e-4903-bf0f-4ee43047e172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:32.103330 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f76913-ac3e-4903-bf0f-4ee43047e172 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:32.124059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 335/662] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:32.125469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f76913-ac3e-4903-bf0f-4ee43047e172 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:32.182170 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c3f11-b2f6-4082-9f14-53fca3cb5d59 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:32.199028 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:32.237453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916336f-4e33-45e6-a7ee-f326907ceac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:32.239187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916336f-4e33-45e6-a7ee-f326907ceac4 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:32.239187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916336f-4e33-45e6-a7ee-f326907ceac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:32.239187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916336f-4e33-45e6-a7ee-f326907ceac4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:32.256833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916336f-4e33-45e6-a7ee-f326907ceac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-0916336f-4e33-45e6-a7ee-f326907ceac4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:32.264324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:32.266350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 328/663] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:32.267213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916336f-4e33-45e6-a7ee-f326907ceac4 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:32.286516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f76913-ac3e-4903-bf0f-4ee43047e172 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:32.322874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:32.354122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db828b9-6861-4edf-a3d5-366b61042ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:32.354122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db828b9-6861-4edf-a3d5-366b61042ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:32.354122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db828b9-6861-4edf-a3d5-366b61042ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:32.354122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db828b9-6861-4edf-a3d5-366b61042ac9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:32.412024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916336f-4e33-45e6-a7ee-f326907ceac4 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:32.455446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db828b9-6861-4edf-a3d5-366b61042ac9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:32.457410 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db828b9-6861-4edf-a3d5-366b61042ac9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:32.459179 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55c340-b509-4fc9-b400-fd014224430b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:32.459920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55c340-b509-4fc9-b400-fd014224430b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:32.460541 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55c340-b509-4fc9-b400-fd014224430b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:32.460927 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55c340-b509-4fc9-b400-fd014224430b None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:32.462735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55c340-b509-4fc9-b400-fd014224430b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:32.463143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55c340-b509-4fc9-b400-fd014224430b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:32.464655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55c340-b509-4fc9-b400-fd014224430b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:32.483086 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 329/664] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:32.483796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55c340-b509-4fc9-b400-fd014224430b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:32.523380 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:32.607749 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 336/665] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:32.608606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db828b9-6861-4edf-a3d5-366b61042ac9 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:32.617224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55c340-b509-4fc9-b400-fd014224430b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:32.621973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:32.665423 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1a6fa-c47e-4a03-a7cb-fff00b92575d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:32.666445 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1a6fa-c47e-4a03-a7cb-fff00b92575d None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:32.666660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1a6fa-c47e-4a03-a7cb-fff00b92575d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:32.666853 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1a6fa-c47e-4a03-a7cb-fff00b92575d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:32.667652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1a6fa-c47e-4a03-a7cb-fff00b92575d None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=739b8f31f1d74459a7348c3ed699812c) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:32.667957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1a6fa-c47e-4a03-a7cb-fff00b92575d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:32.669694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1a6fa-c47e-4a03-a7cb-fff00b92575d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:32.686901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 330/666] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:32 2022] GET /identity/v3/role_assignments?user.id=739b8f31f1d74459a7348c3ed699812c&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:32.688606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1a6fa-c47e-4a03-a7cb-fff00b92575d None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:32.758579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db828b9-6861-4edf-a3d5-366b61042ac9 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:32.821681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac409856-d86a-424b-a456-92bf1f115f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:32.822661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac409856-d86a-424b-a456-92bf1f115f19 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:32.823186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac409856-d86a-424b-a456-92bf1f115f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:32.823956 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac409856-d86a-424b-a456-92bf1f115f19 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:32.825531 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac409856-d86a-424b-a456-92bf1f115f19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:32.826217 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac409856-d86a-424b-a456-92bf1f115f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:32.828270 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac409856-d86a-424b-a456-92bf1f115f19 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:32.841954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 337/667] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:32.843746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac409856-d86a-424b-a456-92bf1f115f19 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:32.848025 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:32.851199 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1a6fa-c47e-4a03-a7cb-fff00b92575d None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:32.898194 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8893e-ce9d-4b2d-bdfc-c55395877b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:32.899233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8893e-ce9d-4b2d-bdfc-c55395877b69 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:32.899814 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8893e-ce9d-4b2d-bdfc-c55395877b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:32.900020 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8893e-ce9d-4b2d-bdfc-c55395877b69 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:32.913248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8893e-ce9d-4b2d-bdfc-c55395877b69 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:32.914892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8893e-ce9d-4b2d-bdfc-c55395877b69 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-1ac8893e-ce9d-4b2d-bdfc-c55395877b69 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:32.929285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:32.930494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:32.932008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:32.932008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:32.932008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:32.932008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:32.932008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:32.932008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:32.932008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:32.932008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:32.932008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 08:10:32.932008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:32.932008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 331/668] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:32.932713 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8893e-ce9d-4b2d-bdfc-c55395877b69 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:32.976262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:33.002207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac409856-d86a-424b-a456-92bf1f115f19 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:33.060957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fcd40-6935-4b92-baf2-3941ccdac6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:33.062521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fcd40-6935-4b92-baf2-3941ccdac6ab None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:33.063642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fcd40-6935-4b92-baf2-3941ccdac6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:33.063922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fcd40-6935-4b92-baf2-3941ccdac6ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:33.084205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fcd40-6935-4b92-baf2-3941ccdac6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:33.087393 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fcd40-6935-4b92-baf2-3941ccdac6ab None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:33.088230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8893e-ce9d-4b2d-bdfc-c55395877b69 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-d13fcd40-6935-4b92-baf2-3941ccdac6ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:33.110656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:33.111822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:33.112793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:33.112793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:33.112793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:33.112793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:33.114918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 338/669] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:33.116482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fcd40-6935-4b92-baf2-3941ccdac6ab None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:33.140981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36db575-699c-4e7e-9913-6e5da2a01a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:33.142450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36db575-699c-4e7e-9913-6e5da2a01a87 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:33.142895 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36db575-699c-4e7e-9913-6e5da2a01a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:33.143347 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36db575-699c-4e7e-9913-6e5da2a01a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:33.159091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36db575-699c-4e7e-9913-6e5da2a01a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:33.161456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36db575-699c-4e7e-9913-6e5da2a01a87 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-d36db575-699c-4e7e-9913-6e5da2a01a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:33.182683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:33.183850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:33.184920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:33.184920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:33.184920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:33.184920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:33.187507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 332/670] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:33.189037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36db575-699c-4e7e-9913-6e5da2a01a87 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:33.199880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:33.270157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fcd40-6935-4b92-baf2-3941ccdac6ab None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:33.312753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:33.327808 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50198bb-d613-4a6c-8ffe-b131e8823619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:33.328761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50198bb-d613-4a6c-8ffe-b131e8823619 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:33.328961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50198bb-d613-4a6c-8ffe-b131e8823619 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:33.329326 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50198bb-d613-4a6c-8ffe-b131e8823619 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:33.330994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50198bb-d613-4a6c-8ffe-b131e8823619 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:33.331517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50198bb-d613-4a6c-8ffe-b131e8823619 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:33.333278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50198bb-d613-4a6c-8ffe-b131e8823619 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:33.346959 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36db575-699c-4e7e-9913-6e5da2a01a87 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:33.372878 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 339/671] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Aug 2 08:10:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:33.374064 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50198bb-d613-4a6c-8ffe-b131e8823619 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:33.402767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5a140-415a-4173-8c63-e75d83cc20a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:33.404441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5a140-415a-4173-8c63-e75d83cc20a5 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:33.405674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5a140-415a-4173-8c63-e75d83cc20a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:33.406660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5a140-415a-4173-8c63-e75d83cc20a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:33.408527 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5a140-415a-4173-8c63-e75d83cc20a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:33.409244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5a140-415a-4173-8c63-e75d83cc20a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:33.412461 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5a140-415a-4173-8c63-e75d83cc20a5 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:33.436082 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 333/672] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:33.437630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5a140-415a-4173-8c63-e75d83cc20a5 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:33.544905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50198bb-d613-4a6c-8ffe-b131e8823619 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:33.566959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:33.574253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5a140-415a-4173-8c63-e75d83cc20a5 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:33.596413 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235d0f-edd2-4021-93d8-ab7127ce774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:33.597608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235d0f-edd2-4021-93d8-ab7127ce774f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:33.598123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235d0f-edd2-4021-93d8-ab7127ce774f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:33.598989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235d0f-edd2-4021-93d8-ab7127ce774f None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:33.599882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22235d0f-edd2-4021-93d8-ab7127ce774f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:33.600913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22235d0f-edd2-4021-93d8-ab7127ce774f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:33.602708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22235d0f-edd2-4021-93d8-ab7127ce774f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:33.617505 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 340/673] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:33.619470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235d0f-edd2-4021-93d8-ab7127ce774f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:33.634929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a71b5-bc21-40ca-816e-01bbb50548cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:33.635942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a71b5-bc21-40ca-816e-01bbb50548cb None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:33.636469 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a71b5-bc21-40ca-816e-01bbb50548cb None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:33.637614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a71b5-bc21-40ca-816e-01bbb50548cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:33.655891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:33.740284 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a71b5-bc21-40ca-816e-01bbb50548cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:33.743132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a71b5-bc21-40ca-816e-01bbb50548cb None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:33.778972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235d0f-edd2-4021-93d8-ab7127ce774f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:33.828939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498778a-57f4-4a5e-8237-25e6461fb7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:33.830843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498778a-57f4-4a5e-8237-25e6461fb7fe None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:33.831807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498778a-57f4-4a5e-8237-25e6461fb7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:33.832404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498778a-57f4-4a5e-8237-25e6461fb7fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:33.845296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498778a-57f4-4a5e-8237-25e6461fb7fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:33.847749 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498778a-57f4-4a5e-8237-25e6461fb7fe None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-2498778a-57f4-4a5e-8237-25e6461fb7fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:33.871746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:33.873301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:33.875425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:33.875425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:33.875425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:33.875425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:33.875425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:33.875425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:33.875425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:33.875425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:33.878082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 341/674] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:33.879493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498778a-57f4-4a5e-8237-25e6461fb7fe None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:33.895194 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 334/675] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:33.896710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a71b5-bc21-40ca-816e-01bbb50548cb None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:33.926658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:33.969697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:34.006368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498778a-57f4-4a5e-8237-25e6461fb7fe None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:34.043569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85159bc1-cca4-4b3e-ad05-40df7ffbcc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:34.044615 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159bc1-cca4-4b3e-ad05-40df7ffbcc54 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:34.045099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159bc1-cca4-4b3e-ad05-40df7ffbcc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:34.045596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85159bc1-cca4-4b3e-ad05-40df7ffbcc54 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:34.054969 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85159bc1-cca4-4b3e-ad05-40df7ffbcc54 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:34.056750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85159bc1-cca4-4b3e-ad05-40df7ffbcc54 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:34.068519 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a71b5-bc21-40ca-816e-01bbb50548cb None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-85159bc1-cca4-4b3e-ad05-40df7ffbcc54 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:34.069999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:34.070950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:34.071936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:34.071936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:34.071936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:34.071936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:34.071936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:34.071936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:34.071936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:34.071936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:34.071936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:34.071936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:34.074586 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 342/676] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:34.075710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85159bc1-cca4-4b3e-ad05-40df7ffbcc54 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:34.134326 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1115f5-04b0-49fe-9637-9fd697df63cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:34.134915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1115f5-04b0-49fe-9637-9fd697df63cb None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:34.135210 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1115f5-04b0-49fe-9637-9fd697df63cb None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:34.135996 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1115f5-04b0-49fe-9637-9fd697df63cb None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:34.136360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1115f5-04b0-49fe-9637-9fd697df63cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:34.136677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1115f5-04b0-49fe-9637-9fd697df63cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:34.138166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1115f5-04b0-49fe-9637-9fd697df63cb None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:34.157811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 335/677] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:34.158812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1115f5-04b0-49fe-9637-9fd697df63cb None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:34.182855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:34.193663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85159bc1-cca4-4b3e-ad05-40df7ffbcc54 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:34.232603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8086e-9330-4770-bd1a-a5f37fd35677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:34.234120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8086e-9330-4770-bd1a-a5f37fd35677 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:34.234481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8086e-9330-4770-bd1a-a5f37fd35677 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:34.234856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8086e-9330-4770-bd1a-a5f37fd35677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:34.247275 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8086e-9330-4770-bd1a-a5f37fd35677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:34.248835 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8086e-9330-4770-bd1a-a5f37fd35677 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-81d8086e-9330-4770-bd1a-a5f37fd35677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:34.264785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:34.265820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:34.266954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:34.266954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:34.266954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:34.266954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:34.266954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 343/678] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:34.267918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8086e-9330-4770-bd1a-a5f37fd35677 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:34.282798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:34.289555 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1115f5-04b0-49fe-9637-9fd697df63cb None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:34.335940 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b522b3-d486-49c6-bd8a-0da87f706fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:34.336837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b522b3-d486-49c6-bd8a-0da87f706fae None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:34.337165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b522b3-d486-49c6-bd8a-0da87f706fae None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:34.337513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b522b3-d486-49c6-bd8a-0da87f706fae None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:34.343460 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b522b3-d486-49c6-bd8a-0da87f706fae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:34.343460 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b522b3-d486-49c6-bd8a-0da87f706fae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:34.343460 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b522b3-d486-49c6-bd8a-0da87f706fae None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:34.362447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 336/679] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 08:10:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:34.362982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b522b3-d486-49c6-bd8a-0da87f706fae None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:34.406203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8086e-9330-4770-bd1a-a5f37fd35677 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:34.456749 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62abd4-6241-4916-a616-2fffee3f38e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:34.457761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62abd4-6241-4916-a616-2fffee3f38e5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:34.457876 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62abd4-6241-4916-a616-2fffee3f38e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:34.458252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62abd4-6241-4916-a616-2fffee3f38e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:34.459611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62abd4-6241-4916-a616-2fffee3f38e5 None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=6557be84abb6469d95157570517512fc) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:34.460101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62abd4-6241-4916-a616-2fffee3f38e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:34.462358 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62abd4-6241-4916-a616-2fffee3f38e5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:34.478219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 344/680] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:34 2022] GET /identity/v3/role_assignments?user.id=6557be84abb6469d95157570517512fc&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:34.478219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332e184-9aa9-40a2-ada2-37ae51d82419 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:34.478219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332e184-9aa9-40a2-ada2-37ae51d82419 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:34.478219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332e184-9aa9-40a2-ada2-37ae51d82419 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:34.478219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 345/681] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:34.478219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332e184-9aa9-40a2-ada2-37ae51d82419 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:34.516188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b522b3-d486-49c6-bd8a-0da87f706fae None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:34.518376 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:34.560840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715d856-d949-4180-965d-bd81c8192d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:34.561512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715d856-d949-4180-965d-bd81c8192d26 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:34.561851 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715d856-d949-4180-965d-bd81c8192d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:34.562232 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715d856-d949-4180-965d-bd81c8192d26 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:34.563186 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715d856-d949-4180-965d-bd81c8192d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:34.563496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715d856-d949-4180-965d-bd81c8192d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:34.565057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715d856-d949-4180-965d-bd81c8192d26 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:34.585604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 337/682] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:34.587276 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986370a1-8b0e-447b-9d5c-8673839046e9 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:34.587568 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986370a1-8b0e-447b-9d5c-8673839046e9 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:34.587855 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986370a1-8b0e-447b-9d5c-8673839046e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:34.611821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-986370a1-8b0e-447b-9d5c-8673839046e9 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:34.613067 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-986370a1-8b0e-447b-9d5c-8673839046e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:34.629157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:34.636665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332e184-9aa9-40a2-ada2-37ae51d82419 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:34.701415 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392d9f1-2a6a-4b02-b6fd-48cb9efa49e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:34.701415 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392d9f1-2a6a-4b02-b6fd-48cb9efa49e9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:34.701730 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392d9f1-2a6a-4b02-b6fd-48cb9efa49e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:34.701823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392d9f1-2a6a-4b02-b6fd-48cb9efa49e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:34.710303 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 338/683] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:34.711706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986370a1-8b0e-447b-9d5c-8673839046e9 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:34.800921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392d9f1-2a6a-4b02-b6fd-48cb9efa49e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:34.802534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392d9f1-2a6a-4b02-b6fd-48cb9efa49e9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:34.827572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:34.859144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986370a1-8b0e-447b-9d5c-8673839046e9 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:34.904560 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b28ec-6f9a-4e2d-a7ad-f94fc0293aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:34.905279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b28ec-6f9a-4e2d-a7ad-f94fc0293aaf None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:34.905562 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b28ec-6f9a-4e2d-a7ad-f94fc0293aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:34.905846 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b28ec-6f9a-4e2d-a7ad-f94fc0293aaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:34.913321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b28ec-6f9a-4e2d-a7ad-f94fc0293aaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:34.914892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b28ec-6f9a-4e2d-a7ad-f94fc0293aaf None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-ef3b28ec-6f9a-4e2d-a7ad-f94fc0293aaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:34.927318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:34.929005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:34.930626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:34.930626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:34.930626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:34.930626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:34.930626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:34.930626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:34.930626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:34.930626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:34.930626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 339/684] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:34.930626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b28ec-6f9a-4e2d-a7ad-f94fc0293aaf None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:34.945889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:34.957157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 346/685] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:34.957157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392d9f1-2a6a-4b02-b6fd-48cb9efa49e9 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:35.076964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b28ec-6f9a-4e2d-a7ad-f94fc0293aaf None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:35.098690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392d9f1-2a6a-4b02-b6fd-48cb9efa49e9 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:35.112718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:35.123250 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66346ebb-ac9c-4e84-afa2-47ecb6a77e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:35.125314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66346ebb-ac9c-4e84-afa2-47ecb6a77e22 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:35.126075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66346ebb-ac9c-4e84-afa2-47ecb6a77e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:35.126610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66346ebb-ac9c-4e84-afa2-47ecb6a77e22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:35.139881 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66346ebb-ac9c-4e84-afa2-47ecb6a77e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-66346ebb-ac9c-4e84-afa2-47ecb6a77e22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:35.147182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:35.148261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:35.149364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:35.156896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363c072-223a-4d1c-8414-8edb586cd2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:35.156896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c072-223a-4d1c-8414-8edb586cd2bc None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:35.156896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c072-223a-4d1c-8414-8edb586cd2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:35.156896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c072-223a-4d1c-8414-8edb586cd2bc None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:35.157512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363c072-223a-4d1c-8414-8edb586cd2bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:35.157512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363c072-223a-4d1c-8414-8edb586cd2bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:35.157512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363c072-223a-4d1c-8414-8edb586cd2bc None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:35.158276 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 340/686] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:35.159487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66346ebb-ac9c-4e84-afa2-47ecb6a77e22 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:35.178373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 347/687] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:35.179469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363c072-223a-4d1c-8414-8edb586cd2bc None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:35.245053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:35.288347 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66346ebb-ac9c-4e84-afa2-47ecb6a77e22 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:35.308713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363c072-223a-4d1c-8414-8edb586cd2bc None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:35.332458 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61e3fb-e27f-4b2f-90ff-917b60224501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:35.332875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e3fb-e27f-4b2f-90ff-917b60224501 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:35.333154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e3fb-e27f-4b2f-90ff-917b60224501 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:35.336536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e3fb-e27f-4b2f-90ff-917b60224501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:35.346731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61e3fb-e27f-4b2f-90ff-917b60224501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:35.348629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61e3fb-e27f-4b2f-90ff-917b60224501 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:35.363897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e9b46-b980-4fd5-a69b-ec35376df3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:35.364568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e9b46-b980-4fd5-a69b-ec35376df3ce None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:35.364854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e9b46-b980-4fd5-a69b-ec35376df3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:35.365135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e9b46-b980-4fd5-a69b-ec35376df3ce None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:35.365861 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e9b46-b980-4fd5-a69b-ec35376df3ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:35.366298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e9b46-b980-4fd5-a69b-ec35376df3ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:35.367789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e9b46-b980-4fd5-a69b-ec35376df3ce None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-3b61e3fb-e27f-4b2f-90ff-917b60224501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:35.370864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:35.371932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:35.373019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:35.373019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:35.373019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:35.373019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:35.375961 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 341/688] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:35.376941 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61e3fb-e27f-4b2f-90ff-917b60224501 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:35.381710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 348/689] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:35.381710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ab841-9db1-4cc7-aa5c-bdcf05797bc3 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:35.381710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ab841-9db1-4cc7-aa5c-bdcf05797bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:35.381710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95ab841-9db1-4cc7-aa5c-bdcf05797bc3 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:35.385500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 349/690] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:35.386384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ab841-9db1-4cc7-aa5c-bdcf05797bc3 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:35.418752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:35.508794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95ab841-9db1-4cc7-aa5c-bdcf05797bc3 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:35.530907 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61e3fb-e27f-4b2f-90ff-917b60224501 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:35.557694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73123fa-fe7a-485e-b3fb-0d4716487be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:35.558718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73123fa-fe7a-485e-b3fb-0d4716487be0 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:35.559177 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73123fa-fe7a-485e-b3fb-0d4716487be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:35.559637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73123fa-fe7a-485e-b3fb-0d4716487be0 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:35.560781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73123fa-fe7a-485e-b3fb-0d4716487be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:35.561313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73123fa-fe7a-485e-b3fb-0d4716487be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:35.563353 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73123fa-fe7a-485e-b3fb-0d4716487be0 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:35.570468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:35.582677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 350/691] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:35.582677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73123fa-fe7a-485e-b3fb-0d4716487be0 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:35.594516 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd8397-0107-4828-ae36-bb785095d769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:35.595162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd8397-0107-4828-ae36-bb785095d769 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:35.595441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd8397-0107-4828-ae36-bb785095d769 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:35.595708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd8397-0107-4828-ae36-bb785095d769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:35.596493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd8397-0107-4828-ae36-bb785095d769 None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=e68c134016414ea5b851bde233ed9951) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:35.597107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd8397-0107-4828-ae36-bb785095d769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:35.598243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd8397-0107-4828-ae36-bb785095d769 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:35.605777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 342/692] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:35 2022] GET /identity/v3/role_assignments?user.id=e68c134016414ea5b851bde233ed9951&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:35.613540 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235c2d7-c3d6-4404-bff3-6a7d20d38bb5 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:35.614679 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235c2d7-c3d6-4404-bff3-6a7d20d38bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:35.615360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235c2d7-c3d6-4404-bff3-6a7d20d38bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:35.656951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-2235c2d7-c3d6-4404-bff3-6a7d20d38bb5 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:35.660634 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2235c2d7-c3d6-4404-bff3-6a7d20d38bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:35.723596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:35.741824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73123fa-fe7a-485e-b3fb-0d4716487be0 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:35.778578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 343/693] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:35.779669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235c2d7-c3d6-4404-bff3-6a7d20d38bb5 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:35.802664 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb89833-5b91-4e29-a030-4a0e0186e64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:35.805062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb89833-5b91-4e29-a030-4a0e0186e64b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:35.805472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb89833-5b91-4e29-a030-4a0e0186e64b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:35.805765 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb89833-5b91-4e29-a030-4a0e0186e64b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:35.826061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb89833-5b91-4e29-a030-4a0e0186e64b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:35.829404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb89833-5b91-4e29-a030-4a0e0186e64b None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-dbb89833-5b91-4e29-a030-4a0e0186e64b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:35.854901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:35.856104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:35.857701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:35.857701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:35.857701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:35.857701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:35.860669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 351/694] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:35.862556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb89833-5b91-4e29-a030-4a0e0186e64b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:35.978039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235c2d7-c3d6-4404-bff3-6a7d20d38bb5 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:36.006394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:36.047665 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499a5ce-5408-46ca-8c09-0093d6ac5a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:36.049106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499a5ce-5408-46ca-8c09-0093d6ac5a7a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:36.049837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499a5ce-5408-46ca-8c09-0093d6ac5a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:36.050664 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499a5ce-5408-46ca-8c09-0093d6ac5a7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:36.058676 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb89833-5b91-4e29-a030-4a0e0186e64b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:36.062228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499a5ce-5408-46ca-8c09-0093d6ac5a7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:36.064363 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499a5ce-5408-46ca-8c09-0093d6ac5a7a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-8499a5ce-5408-46ca-8c09-0093d6ac5a7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:36.084631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:36.085712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:36.086793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:36.086793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:36.086793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:36.086793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:36.086793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:36.086793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:36.086793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:36.086793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:36.086793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 344/695] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:36.087960 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499a5ce-5408-46ca-8c09-0093d6ac5a7a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:36.108811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b76af3-d427-413d-b642-e926765c712e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:36.109657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b76af3-d427-413d-b642-e926765c712e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:36.109946 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b76af3-d427-413d-b642-e926765c712e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:36.110572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b76af3-d427-413d-b642-e926765c712e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:36.125614 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b76af3-d427-413d-b642-e926765c712e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:36.127815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b76af3-d427-413d-b642-e926765c712e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:36.129948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-03b76af3-d427-413d-b642-e926765c712e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:36.148386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:36.149732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:36.151087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:36.151087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:36.151087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:36.151087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:36.154104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 352/696] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:36.155898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b76af3-d427-413d-b642-e926765c712e None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:36.250205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499a5ce-5408-46ca-8c09-0093d6ac5a7a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:36.293294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3df9bb-864f-43c0-9f26-4e24112c7a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:36.294260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3df9bb-864f-43c0-9f26-4e24112c7a4b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:36.294674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3df9bb-864f-43c0-9f26-4e24112c7a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:36.295090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3df9bb-864f-43c0-9f26-4e24112c7a4b None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:36.296572 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3df9bb-864f-43c0-9f26-4e24112c7a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:36.297054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3df9bb-864f-43c0-9f26-4e24112c7a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:36.298658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3df9bb-864f-43c0-9f26-4e24112c7a4b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:36.313956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 345/697] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:36.315367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3df9bb-864f-43c0-9f26-4e24112c7a4b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:36.322309 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b76af3-d427-413d-b642-e926765c712e None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:36.355694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:36.364631 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64629ac5-edbd-49a4-ba6c-0d5ddbd6d206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:36.366195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64629ac5-edbd-49a4-ba6c-0d5ddbd6d206 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:36.366320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64629ac5-edbd-49a4-ba6c-0d5ddbd6d206 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:36.366864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64629ac5-edbd-49a4-ba6c-0d5ddbd6d206 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:36.368555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64629ac5-edbd-49a4-ba6c-0d5ddbd6d206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:36.368947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64629ac5-edbd-49a4-ba6c-0d5ddbd6d206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:36.370646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64629ac5-edbd-49a4-ba6c-0d5ddbd6d206 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:36.387211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 353/698] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:36.388249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64629ac5-edbd-49a4-ba6c-0d5ddbd6d206 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:36.440972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3df9bb-864f-43c0-9f26-4e24112c7a4b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:36.454388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:36.487815 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b11eab-620b-44c2-aa71-19269414b53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:36.489027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11eab-620b-44c2-aa71-19269414b53f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:36.489484 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11eab-620b-44c2-aa71-19269414b53f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:36.489959 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11eab-620b-44c2-aa71-19269414b53f None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:36.491036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b11eab-620b-44c2-aa71-19269414b53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:36.491523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b11eab-620b-44c2-aa71-19269414b53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:36.493682 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b11eab-620b-44c2-aa71-19269414b53f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:36.508622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 346/699] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:36.509709 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b11eab-620b-44c2-aa71-19269414b53f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:36.519818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64629ac5-edbd-49a4-ba6c-0d5ddbd6d206 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:36.564343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd55b0a-19a6-4845-b236-49f59238b2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:36.565116 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd55b0a-19a6-4845-b236-49f59238b2ba None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:36.565536 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd55b0a-19a6-4845-b236-49f59238b2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:36.565946 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd55b0a-19a6-4845-b236-49f59238b2ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:36.574705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd55b0a-19a6-4845-b236-49f59238b2ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:36.576423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd55b0a-19a6-4845-b236-49f59238b2ba None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-9fd55b0a-19a6-4845-b236-49f59238b2ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:36.592226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:36.593987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:36.595158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:36.595158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:36.595158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:36.595158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:36.595158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:36.595158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:36.595158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:36.595158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:36.595158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:36.595158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:36.597318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 354/700] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 08:10:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:36.598523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd55b0a-19a6-4845-b236-49f59238b2ba None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:36.644661 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:36.653147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b11eab-620b-44c2-aa71-19269414b53f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:36.691272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa391d-682a-495f-88b3-3839d966af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:36.692150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa391d-682a-495f-88b3-3839d966af0c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:36.692673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa391d-682a-495f-88b3-3839d966af0c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:36.693147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa391d-682a-495f-88b3-3839d966af0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:36.694248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa391d-682a-495f-88b3-3839d966af0c None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=e02b653d2f5e4faca2906b2fbd1bfc5c) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:36.694780 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa391d-682a-495f-88b3-3839d966af0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:36.696622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa391d-682a-495f-88b3-3839d966af0c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:36.704427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 347/701] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:36 2022] GET /identity/v3/role_assignments?user.id=e02b653d2f5e4faca2906b2fbd1bfc5c&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:36.705705 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa391d-682a-495f-88b3-3839d966af0c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:36.728465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd55b0a-19a6-4845-b236-49f59238b2ba None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:36.747636 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:36.812345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656079-530f-4d96-b91a-ba044220c57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:36.813046 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656079-530f-4d96-b91a-ba044220c57a None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:36.813286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656079-530f-4d96-b91a-ba044220c57a None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:36.813541 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5656079-530f-4d96-b91a-ba044220c57a None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:36.814473 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5656079-530f-4d96-b91a-ba044220c57a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:36.815937 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5656079-530f-4d96-b91a-ba044220c57a None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:36.840302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa391d-682a-495f-88b3-3839d966af0c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:36.882375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 355/702] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:10:36 2022] POST /identity/v3/users => generated 254 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:10:36.895707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adc8f3-3ac8-43aa-b9cd-050dd531c889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:36.897073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc8f3-3ac8-43aa-b9cd-050dd531c889 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:36.897756 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc8f3-3ac8-43aa-b9cd-050dd531c889 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:36.898567 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adc8f3-3ac8-43aa-b9cd-050dd531c889 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:36.900461 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adc8f3-3ac8-43aa-b9cd-050dd531c889 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:36.901319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adc8f3-3ac8-43aa-b9cd-050dd531c889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:36.904309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adc8f3-3ac8-43aa-b9cd-050dd531c889 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:36.935989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 348/703] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 08:10:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:36.946116 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656079-530f-4d96-b91a-ba044220c57a None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:36.987022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3df01-656a-4de0-a826-876f35d6595f None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:36.987971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3df01-656a-4de0-a826-876f35d6595f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:36.988447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3df01-656a-4de0-a826-876f35d6595f None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:36.990400 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 349/704] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:36.996075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357b19f-2f43-4fd4-90be-88a6bcccdf35 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:36.996408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357b19f-2f43-4fd4-90be-88a6bcccdf35 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:36.996626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357b19f-2f43-4fd4-90be-88a6bcccdf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:37.021812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3357b19f-2f43-4fd4-90be-88a6bcccdf35 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:37.023104 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3357b19f-2f43-4fd4-90be-88a6bcccdf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:37.036219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:37.104469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5656079-530f-4d96-b91a-ba044220c57a None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:37.118161 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 350/705] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:10:37.142847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357b19f-2f43-4fd4-90be-88a6bcccdf35 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:37.159741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8155a5-77a8-41cf-963c-7a149007ee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:37.160385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8155a5-77a8-41cf-963c-7a149007ee84 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:37.160649 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8155a5-77a8-41cf-963c-7a149007ee84 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:37.160926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8155a5-77a8-41cf-963c-7a149007ee84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:37.217598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:37.254219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8155a5-77a8-41cf-963c-7a149007ee84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:37.256062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8155a5-77a8-41cf-963c-7a149007ee84 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:37.291769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357b19f-2f43-4fd4-90be-88a6bcccdf35 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:37.337052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99400566-0e00-411b-ac06-1d1e85e8e78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:37.337724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99400566-0e00-411b-ac06-1d1e85e8e78b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:37.338002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99400566-0e00-411b-ac06-1d1e85e8e78b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:37.338307 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99400566-0e00-411b-ac06-1d1e85e8e78b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:37.338950 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99400566-0e00-411b-ac06-1d1e85e8e78b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:37.340682 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99400566-0e00-411b-ac06-1d1e85e8e78b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-99400566-0e00-411b-ac06-1d1e85e8e78b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:37.357508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:37.358610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:37.359731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 351/706] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Aug 2 08:10:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:37.369844 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99400566-0e00-411b-ac06-1d1e85e8e78b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:37.394390 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:37.416783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 356/707] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:37.423175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8155a5-77a8-41cf-963c-7a149007ee84 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:37.557698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:37.563215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99400566-0e00-411b-ac06-1d1e85e8e78b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:37.606428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ca847-c722-4fd3-af50-f39999f689de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:37.607305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ca847-c722-4fd3-af50-f39999f689de None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:37.607649 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ca847-c722-4fd3-af50-f39999f689de None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:37.607879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ca847-c722-4fd3-af50-f39999f689de None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:37.609309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ca847-c722-4fd3-af50-f39999f689de None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:37.609621 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ca847-c722-4fd3-af50-f39999f689de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:37.611138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ca847-c722-4fd3-af50-f39999f689de None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:37.617093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 352/708] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 08:10:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:37.622792 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ca847-c722-4fd3-af50-f39999f689de None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:37.654762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8155a5-77a8-41cf-963c-7a149007ee84 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:37.749617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445401f8-d50c-4a64-a256-6c865e71dacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:37.750330 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445401f8-d50c-4a64-a256-6c865e71dacd None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:37.750612 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445401f8-d50c-4a64-a256-6c865e71dacd None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:37.750887 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445401f8-d50c-4a64-a256-6c865e71dacd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:37.772169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445401f8-d50c-4a64-a256-6c865e71dacd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:37.773631 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445401f8-d50c-4a64-a256-6c865e71dacd None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-445401f8-d50c-4a64-a256-6c865e71dacd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:37.807607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:37.808640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:37.809568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:37.809568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:37.809568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:37.809568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:37.809568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 357/709] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:37.816001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445401f8-d50c-4a64-a256-6c865e71dacd None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:37.883984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:37.959353 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ca847-c722-4fd3-af50-f39999f689de None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:38.064006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dec48c-d45f-4c0f-bb43-9f585f5eeb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:38.064698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dec48c-d45f-4c0f-bb43-9f585f5eeb0f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:38.065032 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dec48c-d45f-4c0f-bb43-9f585f5eeb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:38.065143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dec48c-d45f-4c0f-bb43-9f585f5eeb0f None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:38.065834 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dec48c-d45f-4c0f-bb43-9f585f5eeb0f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:38.066172 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dec48c-d45f-4c0f-bb43-9f585f5eeb0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:38.069450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dec48c-d45f-4c0f-bb43-9f585f5eeb0f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:38.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 353/710] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 08:10:37 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:38.093523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445401f8-d50c-4a64-a256-6c865e71dacd None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:38.137550 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:38.156195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e40505-c79f-4418-847e-00b8b2134bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:38.157191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40505-c79f-4418-847e-00b8b2134bea None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:38.157639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40505-c79f-4418-847e-00b8b2134bea None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:38.158105 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40505-c79f-4418-847e-00b8b2134bea None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:38.159248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e40505-c79f-4418-847e-00b8b2134bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:38.159752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e40505-c79f-4418-847e-00b8b2134bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:38.162224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e40505-c79f-4418-847e-00b8b2134bea None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:38.189860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 358/711] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:38.196042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dec48c-d45f-4c0f-bb43-9f585f5eeb0f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:38.319654 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9d4cc-4bad-452e-82d5-e4c96c8ac80a None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:38.320110 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9d4cc-4bad-452e-82d5-e4c96c8ac80a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:38.320613 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9d4cc-4bad-452e-82d5-e4c96c8ac80a None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:38.327244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 359/712] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:10:38.329483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4760b2-4b0d-4664-804f-15f0539879fc None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:38.329954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4760b2-4b0d-4664-804f-15f0539879fc None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:38.330443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4760b2-4b0d-4664-804f-15f0539879fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:38.371344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dec48c-d45f-4c0f-bb43-9f585f5eeb0f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:38.374398 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-aa4760b2-4b0d-4664-804f-15f0539879fc None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:38.376408 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-aa4760b2-4b0d-4664-804f-15f0539879fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:38.424138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a43c8-4c39-4b33-bc65-94f8a63a400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:38.424722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a43c8-4c39-4b33-bc65-94f8a63a400b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:38.425003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a43c8-4c39-4b33-bc65-94f8a63a400b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:38.425279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a43c8-4c39-4b33-bc65-94f8a63a400b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:38.444868 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a43c8-4c39-4b33-bc65-94f8a63a400b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:38.446382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a43c8-4c39-4b33-bc65-94f8a63a400b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:38.449394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-495a43c8-4c39-4b33-bc65-94f8a63a400b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:38.463867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:38.465106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:38.466152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:38.466152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:38.466152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:38.466152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:38.466152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:38.466152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:38.466152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:38.466152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:38.468749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 354/713] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:38.477775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a43c8-4c39-4b33-bc65-94f8a63a400b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:38.568214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 360/714] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:38.618531 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4760b2-4b0d-4664-804f-15f0539879fc None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:38.687856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a43c8-4c39-4b33-bc65-94f8a63a400b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:38.782264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4760b2-4b0d-4664-804f-15f0539879fc None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:38.804134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d3d18-3447-4954-9af4-dcc77cbe41ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:38.805272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d3d18-3447-4954-9af4-dcc77cbe41ce None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:38.807209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d3d18-3447-4954-9af4-dcc77cbe41ce None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:38.807952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d3d18-3447-4954-9af4-dcc77cbe41ce None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:38.810378 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d3d18-3447-4954-9af4-dcc77cbe41ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:38.810907 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d3d18-3447-4954-9af4-dcc77cbe41ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:38.812699 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d3d18-3447-4954-9af4-dcc77cbe41ce None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:38.813186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:38.849168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 355/715] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:38.855477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d3d18-3447-4954-9af4-dcc77cbe41ce None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:38.869886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4223d9-00aa-40a7-8263-4208fb517dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:38.871650 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4223d9-00aa-40a7-8263-4208fb517dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:38.872178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4223d9-00aa-40a7-8263-4208fb517dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:38.872658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4223d9-00aa-40a7-8263-4208fb517dd2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:38.873516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4223d9-00aa-40a7-8263-4208fb517dd2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:38.875219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4223d9-00aa-40a7-8263-4208fb517dd2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-cd4223d9-00aa-40a7-8263-4208fb517dd2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:38.893111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:38.894225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:10:38.895109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:38.907257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 361/716] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:38 2022] GET /identity/v3/services/network => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:38.912848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4223d9-00aa-40a7-8263-4208fb517dd2 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:39.002666 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:39.118362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d3d18-3447-4954-9af4-dcc77cbe41ce None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:39.146935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4223d9-00aa-40a7-8263-4208fb517dd2 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:39.210600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ee28d-b366-4b48-ad9b-0289f13b172a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:39.211657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ee28d-b366-4b48-ad9b-0289f13b172a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:39.212140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ee28d-b366-4b48-ad9b-0289f13b172a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:39.212618 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ee28d-b366-4b48-ad9b-0289f13b172a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:39.214114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ee28d-b366-4b48-ad9b-0289f13b172a None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=93143507a8784a30bc6b4a5e1f24f0b6) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:39.214668 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ee28d-b366-4b48-ad9b-0289f13b172a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:39.217412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ee28d-b366-4b48-ad9b-0289f13b172a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:39.241302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 356/717] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:38 2022] GET /identity/v3/role_assignments?user.id=93143507a8784a30bc6b4a5e1f24f0b6&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 259 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:39.246165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c7330-aa81-4bdb-bb2b-1e33ebd5ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:39.247126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7330-aa81-4bdb-bb2b-1e33ebd5ab32 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:39.247560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7330-aa81-4bdb-bb2b-1e33ebd5ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:39.247987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7330-aa81-4bdb-bb2b-1e33ebd5ab32 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:39.249608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c7330-aa81-4bdb-bb2b-1e33ebd5ab32 None admin] RBAC: Adding query filter params (name=network) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:39.250251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c7330-aa81-4bdb-bb2b-1e33ebd5ab32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:39.252530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c7330-aa81-4bdb-bb2b-1e33ebd5ab32 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:39.266803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 362/718] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:10:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:39.273720 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ee28d-b366-4b48-ad9b-0289f13b172a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:39.464939 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ee28d-b366-4b48-ad9b-0289f13b172a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:39.491716 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:39.509798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3303c-ac8d-4539-95ba-38fd3f814746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:39.510491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3303c-ac8d-4539-95ba-38fd3f814746 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:39.510772 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3303c-ac8d-4539-95ba-38fd3f814746 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:39.511049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3303c-ac8d-4539-95ba-38fd3f814746 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:39.511748 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3303c-ac8d-4539-95ba-38fd3f814746 None admin] RBAC: Adding query filter params (type=network) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:39.512054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3303c-ac8d-4539-95ba-38fd3f814746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:39.513509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3303c-ac8d-4539-95ba-38fd3f814746 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:39.519637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 357/719] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:10:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:39.881962 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb268-73da-40e6-abb8-78e348ea088f None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:39.882483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb268-73da-40e6-abb8-78e348ea088f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:39.882483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cb268-73da-40e6-abb8-78e348ea088f None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:39.884130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 363/720] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:39.890067 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be3ed1-73f1-404d-b53b-0d6756fb9930 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:39.890361 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be3ed1-73f1-404d-b53b-0d6756fb9930 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:39.890627 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be3ed1-73f1-404d-b53b-0d6756fb9930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:39.917812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-22be3ed1-73f1-404d-b53b-0d6756fb9930 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:39.919057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-22be3ed1-73f1-404d-b53b-0d6756fb9930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:40.035451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 358/721] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:40.060768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cb268-73da-40e6-abb8-78e348ea088f None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:40.068666 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffb6e4-0076-4514-b3a8-eb9673ad68f9 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:40.068991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffb6e4-0076-4514-b3a8-eb9673ad68f9 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:40.069227 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffb6e4-0076-4514-b3a8-eb9673ad68f9 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:40.070917 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 359/722] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:10:40.076329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c9f86-31c2-432c-a8b5-4b2f35f568c0 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:40.076616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c9f86-31c2-432c-a8b5-4b2f35f568c0 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:40.076930 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c9f86-31c2-432c-a8b5-4b2f35f568c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:40.096709 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-7f4c9f86-31c2-432c-a8b5-4b2f35f568c0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:40.097912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7f4c9f86-31c2-432c-a8b5-4b2f35f568c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:40.140768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:40.178229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 360/723] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 08:10:40.196828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c9f86-31c2-432c-a8b5-4b2f35f568c0 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:40.262416 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:40.267117 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cb268-73da-40e6-abb8-78e348ea088f None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:40.309571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c9f86-31c2-432c-a8b5-4b2f35f568c0 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:40.337649 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143363-cfa5-42b4-86c9-299ce698eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:40.338341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143363-cfa5-42b4-86c9-299ce698eced None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:40.338625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143363-cfa5-42b4-86c9-299ce698eced None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:40.338900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd143363-cfa5-42b4-86c9-299ce698eced None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:40.357780 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ed0e2-c59c-4923-9fac-b7d0626881a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:40.358627 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed0e2-c59c-4923-9fac-b7d0626881a6 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:40.358906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed0e2-c59c-4923-9fac-b7d0626881a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:40.362090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed0e2-c59c-4923-9fac-b7d0626881a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:40.364578 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd143363-cfa5-42b4-86c9-299ce698eced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-cd143363-cfa5-42b4-86c9-299ce698eced None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:40.375528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:40.376981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:40.378141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:40.382256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 364/724] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:40.383195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ed0e2-c59c-4923-9fac-b7d0626881a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:40.385159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143363-cfa5-42b4-86c9-299ce698eced None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-db4ed0e2-c59c-4923-9fac-b7d0626881a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:40.393148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:40.395606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:40.397644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:40.405878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 361/725] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:40.409065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ed0e2-c59c-4923-9fac-b7d0626881a6 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:40.566463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ed0e2-c59c-4923-9fac-b7d0626881a6 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:40.590472 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:40.609127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd143363-cfa5-42b4-86c9-299ce698eced None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:40.618404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:40.619334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7a3d8-5665-4ecc-8b60-911fb5257117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:40.619967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a3d8-5665-4ecc-8b60-911fb5257117 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:40.620242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a3d8-5665-4ecc-8b60-911fb5257117 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:40.620507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a3d8-5665-4ecc-8b60-911fb5257117 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:40.621239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7a3d8-5665-4ecc-8b60-911fb5257117 None admin] RBAC: Adding query filter params (name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:40.621544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7a3d8-5665-4ecc-8b60-911fb5257117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:40.625250 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7a3d8-5665-4ecc-8b60-911fb5257117 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:40.645420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 362/726] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:40.647978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7a3d8-5665-4ecc-8b60-911fb5257117 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:40.678511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3935af-f871-469d-aece-2bee02b4d84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:40.679377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3935af-f871-469d-aece-2bee02b4d84d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:40.679807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3935af-f871-469d-aece-2bee02b4d84d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:40.680320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3935af-f871-469d-aece-2bee02b4d84d None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:40.681566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3935af-f871-469d-aece-2bee02b4d84d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:40.682108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3935af-f871-469d-aece-2bee02b4d84d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:40.684762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3935af-f871-469d-aece-2bee02b4d84d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:40.698844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 365/727] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:40.704661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3935af-f871-469d-aece-2bee02b4d84d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:40.808986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7a3d8-5665-4ecc-8b60-911fb5257117 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:40.820031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3935af-f871-469d-aece-2bee02b4d84d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:40.851774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f895667-7913-413b-9fd8-044fbda0df2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:40.852403 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f895667-7913-413b-9fd8-044fbda0df2b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:40.852680 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f895667-7913-413b-9fd8-044fbda0df2b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:40.852950 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f895667-7913-413b-9fd8-044fbda0df2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:40.862550 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da6aa9f-6dbd-411c-9898-a2940c69f56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:40.863650 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6aa9f-6dbd-411c-9898-a2940c69f56e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:40.864233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6aa9f-6dbd-411c-9898-a2940c69f56e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:40.864888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da6aa9f-6dbd-411c-9898-a2940c69f56e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:40.865650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f895667-7913-413b-9fd8-044fbda0df2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:40.867256 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f895667-7913-413b-9fd8-044fbda0df2b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:40.880720 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6aa9f-6dbd-411c-9898-a2940c69f56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:40.882875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da6aa9f-6dbd-411c-9898-a2940c69f56e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-8f895667-7913-413b-9fd8-044fbda0df2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:40.885409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:40.886489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:40.887740 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:40.887740 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:40.887740 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:40.887740 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:40.887740 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 363/728] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:40.888631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad99210-1ccc-4636-a5f3-9258474659d1 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:40.888631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad99210-1ccc-4636-a5f3-9258474659d1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:40.888792 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad99210-1ccc-4636-a5f3-9258474659d1 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:40.895572 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 364/729] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:40.900168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad99210-1ccc-4636-a5f3-9258474659d1 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-6da6aa9f-6dbd-411c-9898-a2940c69f56e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:40.914332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:40.916324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:40.918068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:40.918068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:40.918068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:40.918068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:40.918068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 366/730] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:40.919331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78783188-803e-4514-b108-1417d2aa007f None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:40.919597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78783188-803e-4514-b108-1417d2aa007f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:40.919910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78783188-803e-4514-b108-1417d2aa007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:40.949618 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:40.955617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-78783188-803e-4514-b108-1417d2aa007f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:40.957515 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-78783188-803e-4514-b108-1417d2aa007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:40.978105 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:41.086072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 367/731] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:41.086072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78783188-803e-4514-b108-1417d2aa007f None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:41.102489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad99210-1ccc-4636-a5f3-9258474659d1 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:41.147094 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cfe79-00c1-4cfd-993f-e4f9ac64adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:41.147648 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cfe79-00c1-4cfd-993f-e4f9ac64adac None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:41.147954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cfe79-00c1-4cfd-993f-e4f9ac64adac None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:41.148234 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cfe79-00c1-4cfd-993f-e4f9ac64adac None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:41.148976 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cfe79-00c1-4cfd-993f-e4f9ac64adac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:41.149298 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cfe79-00c1-4cfd-993f-e4f9ac64adac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:41.151217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cfe79-00c1-4cfd-993f-e4f9ac64adac None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:41.167219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 365/732] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:41.168193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cfe79-00c1-4cfd-993f-e4f9ac64adac None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:41.255784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78783188-803e-4514-b108-1417d2aa007f None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:41.264812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:41.288768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cfe79-00c1-4cfd-993f-e4f9ac64adac None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:41.303084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6fec4-3807-4bf3-8f62-f4a2d95f4a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:41.304485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6fec4-3807-4bf3-8f62-f4a2d95f4a1f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:41.304982 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6fec4-3807-4bf3-8f62-f4a2d95f4a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:41.305407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6fec4-3807-4bf3-8f62-f4a2d95f4a1f None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:41.306343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6fec4-3807-4bf3-8f62-f4a2d95f4a1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:41.306976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6fec4-3807-4bf3-8f62-f4a2d95f4a1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:41.308711 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6fec4-3807-4bf3-8f62-f4a2d95f4a1f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:41.323326 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 368/733] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:41.324810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6fec4-3807-4bf3-8f62-f4a2d95f4a1f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:41.329064 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:41.332506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dd5b5-3570-4b8d-851f-721c83775818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:41.333801 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dd5b5-3570-4b8d-851f-721c83775818 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:41.334296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dd5b5-3570-4b8d-851f-721c83775818 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:41.334728 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dd5b5-3570-4b8d-851f-721c83775818 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:41.336451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dd5b5-3570-4b8d-851f-721c83775818 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:41.338167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dd5b5-3570-4b8d-851f-721c83775818 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:41.371148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 366/734] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:10:41 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:10:41.373135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dd5b5-3570-4b8d-851f-721c83775818 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:41.529058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6fec4-3807-4bf3-8f62-f4a2d95f4a1f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:41.547131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dd5b5-3570-4b8d-851f-721c83775818 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:41.605894 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c8481-9aa1-4602-ab3d-a3a8c981aa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:41.607348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8481-9aa1-4602-ab3d-a3a8c981aa84 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:41.608911 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8481-9aa1-4602-ab3d-a3a8c981aa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:41.609363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8481-9aa1-4602-ab3d-a3a8c981aa84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:41.612986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b745c44-7007-4ee2-b9c7-9aab69d67286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:41.613926 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b745c44-7007-4ee2-b9c7-9aab69d67286 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:41.615699 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b745c44-7007-4ee2-b9c7-9aab69d67286 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:41.616161 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b745c44-7007-4ee2-b9c7-9aab69d67286 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:41.623721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:41.627387 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c8481-9aa1-4602-ab3d-a3a8c981aa84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:41.629109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c8481-9aa1-4602-ab3d-a3a8c981aa84 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:41.632526 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b745c44-7007-4ee2-b9c7-9aab69d67286 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:41.633684 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b745c44-7007-4ee2-b9c7-9aab69d67286 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-ca0c8481-9aa1-4602-ab3d-a3a8c981aa84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:41.646966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:41.648082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:41.649510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:41.649510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:41.649510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:41.649510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:41.649510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:41.649510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:41.649510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:41.649510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:41.649510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:10:41.649510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-9b745c44-7007-4ee2-b9c7-9aab69d67286 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:41.651523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:41.653041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:41.655344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:41.655344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:41.655344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:41.655344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:41.655344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:41.655344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:41.655344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:41.655344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:41.655344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:41.655344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:41.655344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 367/735] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:41.659871 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b745c44-7007-4ee2-b9c7-9aab69d67286 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:41.660101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 369/736] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 08:10:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:41.665858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c8481-9aa1-4602-ab3d-a3a8c981aa84 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:41.769744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:41.816035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b745c44-7007-4ee2-b9c7-9aab69d67286 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:41.833450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c8481-9aa1-4602-ab3d-a3a8c981aa84 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:41.864405 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2b001-0d34-44b0-a398-a87ba66f6b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:41.865409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2b001-0d34-44b0-a398-a87ba66f6b41 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:41.866028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2b001-0d34-44b0-a398-a87ba66f6b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:41.866487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2b001-0d34-44b0-a398-a87ba66f6b41 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:41.867861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2b001-0d34-44b0-a398-a87ba66f6b41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:41.868374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2b001-0d34-44b0-a398-a87ba66f6b41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:41.870890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2b001-0d34-44b0-a398-a87ba66f6b41 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:41.881142 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff123fd-958a-42f3-b49b-6b61acf29198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:41.882061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff123fd-958a-42f3-b49b-6b61acf29198 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:41.882549 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff123fd-958a-42f3-b49b-6b61acf29198 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:41.882776 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff123fd-958a-42f3-b49b-6b61acf29198 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:41.883576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff123fd-958a-42f3-b49b-6b61acf29198 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:41.884121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff123fd-958a-42f3-b49b-6b61acf29198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:41.885392 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff123fd-958a-42f3-b49b-6b61acf29198 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:41.894210 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 368/737] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 08:10:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:41.901322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214928e8-a6b1-4157-8de1-0b2836c924b6 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:41.902133 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214928e8-a6b1-4157-8de1-0b2836c924b6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:41.902645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214928e8-a6b1-4157-8de1-0b2836c924b6 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:41.904698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 369/738] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:41.906273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214928e8-a6b1-4157-8de1-0b2836c924b6 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:41.913733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 370/739] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 08:10:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:41.919382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9ec9-122d-4bc7-a55f-7a470827b6ad None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:41.919382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9ec9-122d-4bc7-a55f-7a470827b6ad None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:41.919382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9ec9-122d-4bc7-a55f-7a470827b6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:41.939627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-baed9ec9-122d-4bc7-a55f-7a470827b6ad None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:41.941377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-baed9ec9-122d-4bc7-a55f-7a470827b6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:42.002697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:42.038291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 371/740] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:42.039779 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed9ec9-122d-4bc7-a55f-7a470827b6ad None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:42.085512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214928e8-a6b1-4157-8de1-0b2836c924b6 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:42.123831 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:42.131650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d78be7-8e5f-43b0-92d8-6034dc582078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:42.132661 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d78be7-8e5f-43b0-92d8-6034dc582078 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:42.133187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d78be7-8e5f-43b0-92d8-6034dc582078 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:42.133670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d78be7-8e5f-43b0-92d8-6034dc582078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:42.187915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed9ec9-122d-4bc7-a55f-7a470827b6ad None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:42.230426 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f22aef-574a-4e11-9777-88c1bd657e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:42.231121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f22aef-574a-4e11-9777-88c1bd657e09 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:42.231404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f22aef-574a-4e11-9777-88c1bd657e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:42.231682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f22aef-574a-4e11-9777-88c1bd657e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:42.234328 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d78be7-8e5f-43b0-92d8-6034dc582078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:42.237435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d78be7-8e5f-43b0-92d8-6034dc582078 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:42.319934 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f22aef-574a-4e11-9777-88c1bd657e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:42.321403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f22aef-574a-4e11-9777-88c1bd657e09 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:42.322826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:42.382049 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:42.391288 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 370/741] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:41 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:42.392216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d78be7-8e5f-43b0-92d8-6034dc582078 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:42.454289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 372/742] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:42 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 08:10:42.455600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c29477-645c-40e7-a593-30271f903c41 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:42.455885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c29477-645c-40e7-a593-30271f903c41 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:42.456156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c29477-645c-40e7-a593-30271f903c41 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:42.462055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 373/743] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:42.462055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c29477-645c-40e7-a593-30271f903c41 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:42.569979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d78be7-8e5f-43b0-92d8-6034dc582078 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:42.612485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c29477-645c-40e7-a593-30271f903c41 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:42.631030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab9a79-0dc0-4ba6-bd13-eecdfcfd16b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:42.631987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab9a79-0dc0-4ba6-bd13-eecdfcfd16b0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:42.632417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab9a79-0dc0-4ba6-bd13-eecdfcfd16b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:42.632850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab9a79-0dc0-4ba6-bd13-eecdfcfd16b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:42.651798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab9a79-0dc0-4ba6-bd13-eecdfcfd16b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-5eab9a79-0dc0-4ba6-bd13-eecdfcfd16b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:42.660163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:42.661270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:42.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:42.662915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 371/744] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:42.663778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab9a79-0dc0-4ba6-bd13-eecdfcfd16b0 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:42.696091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:42.798992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972eaea-c4f2-4ba8-8f31-20a7eac44a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:42.799770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972eaea-c4f2-4ba8-8f31-20a7eac44a19 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:42.800055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972eaea-c4f2-4ba8-8f31-20a7eac44a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:42.800330 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972eaea-c4f2-4ba8-8f31-20a7eac44a19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:42.815968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972eaea-c4f2-4ba8-8f31-20a7eac44a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:42.817453 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972eaea-c4f2-4ba8-8f31-20a7eac44a19 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-a972eaea-c4f2-4ba8-8f31-20a7eac44a19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:42.835325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:42.836335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:42.843375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:42.843375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:42.843375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:42.843375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:42.843375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 374/745] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:42.843675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab9a79-0dc0-4ba6-bd13-eecdfcfd16b0 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:42.843751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e648-f775-4f9d-88e1-f7c6620826dc None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:42.843751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e648-f775-4f9d-88e1-f7c6620826dc None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:42.843751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e648-f775-4f9d-88e1-f7c6620826dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:42.847812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:42.863153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-a636e648-f775-4f9d-88e1-f7c6620826dc None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:42.865197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-a636e648-f775-4f9d-88e1-f7c6620826dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:42.893939 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2af727-3454-4f48-92ce-27bb742ef550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:42.894619 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af727-3454-4f48-92ce-27bb742ef550 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:42.894893 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af727-3454-4f48-92ce-27bb742ef550 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:42.895195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af727-3454-4f48-92ce-27bb742ef550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:42.907507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2af727-3454-4f48-92ce-27bb742ef550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:42.909776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2af727-3454-4f48-92ce-27bb742ef550 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-ce2af727-3454-4f48-92ce-27bb742ef550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:42.935704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:42.936731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:42.937640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:42.937640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:42.937640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:42.937640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:42.937640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 372/746] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:42.938807 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2af727-3454-4f48-92ce-27bb742ef550 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:42.984757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 375/747] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:42 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 08:10:42.985620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e648-f775-4f9d-88e1-f7c6620826dc None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:43.035841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:43.080764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2af727-3454-4f48-92ce-27bb742ef550 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:43.127819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b236e-ae3b-4f02-9b3f-539b02f3e24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:43.128810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b236e-ae3b-4f02-9b3f-539b02f3e24a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:43.129267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b236e-ae3b-4f02-9b3f-539b02f3e24a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:43.129716 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b236e-ae3b-4f02-9b3f-539b02f3e24a None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:43.130759 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b236e-ae3b-4f02-9b3f-539b02f3e24a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:43.131343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b236e-ae3b-4f02-9b3f-539b02f3e24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:43.132875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b236e-ae3b-4f02-9b3f-539b02f3e24a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:43.134238 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e648-f775-4f9d-88e1-f7c6620826dc None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:43.142519 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 373/748] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:43.143639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b236e-ae3b-4f02-9b3f-539b02f3e24a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:43.184769 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc625cdd-7def-456d-a027-d9f4a51b0872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:43.185988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625cdd-7def-456d-a027-d9f4a51b0872 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:43.186693 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625cdd-7def-456d-a027-d9f4a51b0872 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:43.186942 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc625cdd-7def-456d-a027-d9f4a51b0872 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:43.187925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc625cdd-7def-456d-a027-d9f4a51b0872 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:43.188239 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc625cdd-7def-456d-a027-d9f4a51b0872 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:43.189992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc625cdd-7def-456d-a027-d9f4a51b0872 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:43.191682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:43.203310 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 376/749] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:43.204233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc625cdd-7def-456d-a027-d9f4a51b0872 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:43.293156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b236e-ae3b-4f02-9b3f-539b02f3e24a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:43.325214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:43.337006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc625cdd-7def-456d-a027-d9f4a51b0872 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:43.339379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2e846-d479-46f5-9916-e3ac25a95fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:43.340362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2e846-d479-46f5-9916-e3ac25a95fda None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:43.340901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2e846-d479-46f5-9916-e3ac25a95fda None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:43.341292 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2e846-d479-46f5-9916-e3ac25a95fda None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:43.342413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2e846-d479-46f5-9916-e3ac25a95fda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:43.343406 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2e846-d479-46f5-9916-e3ac25a95fda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:43.345770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2e846-d479-46f5-9916-e3ac25a95fda None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:43.362493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 374/750] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:43.363329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2e846-d479-46f5-9916-e3ac25a95fda None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:43.395140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e900f-ad79-401d-bf53-7c47b80e3938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:43.395479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e900f-ad79-401d-bf53-7c47b80e3938 None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:43.395788 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e900f-ad79-401d-bf53-7c47b80e3938 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:43.396093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e900f-ad79-401d-bf53-7c47b80e3938 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:43.396815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e900f-ad79-401d-bf53-7c47b80e3938 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:43.398329 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e900f-ad79-401d-bf53-7c47b80e3938 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:43.430049 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 377/751] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:10:43 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:10:43.430049 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e900f-ad79-401d-bf53-7c47b80e3938 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:43.510318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2e846-d479-46f5-9916-e3ac25a95fda None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:43.523886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:43.578025 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0630-6fd5-45fd-8e87-4acf2efc4115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:43.579526 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0630-6fd5-45fd-8e87-4acf2efc4115 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:43.579526 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0630-6fd5-45fd-8e87-4acf2efc4115 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:43.579936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0630-6fd5-45fd-8e87-4acf2efc4115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:43.593205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae0630-6fd5-45fd-8e87-4acf2efc4115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:43.594799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae0630-6fd5-45fd-8e87-4acf2efc4115 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:43.605427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e900f-ad79-401d-bf53-7c47b80e3938 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-2eae0630-6fd5-45fd-8e87-4acf2efc4115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:43.612866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:43.613854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:43.614794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:43.614794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:43.614794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:43.614794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:43.618838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 375/752] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:43.620166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0630-6fd5-45fd-8e87-4acf2efc4115 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:43.653929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd6fe9-c12b-4d86-bed4-f40d999cbd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:43.655670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd6fe9-c12b-4d86-bed4-f40d999cbd60 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:43.656104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd6fe9-c12b-4d86-bed4-f40d999cbd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:43.656865 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd6fe9-c12b-4d86-bed4-f40d999cbd60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:43.668139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd6fe9-c12b-4d86-bed4-f40d999cbd60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:43.672030 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd6fe9-c12b-4d86-bed4-f40d999cbd60 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:43.673525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-a6cd6fe9-c12b-4d86-bed4-f40d999cbd60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:43.688886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:43.689898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:43.690854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:43.690854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:43.690854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:43.690854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:43.690854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:43.690854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:43.690854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:43.690854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:43.690854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 378/753] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:43.692128 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd6fe9-c12b-4d86-bed4-f40d999cbd60 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:43.769841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0630-6fd5-45fd-8e87-4acf2efc4115 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:43.814458 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87488f8-1ccd-4ae9-a6b1-eeebdb5ba72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:43.815419 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87488f8-1ccd-4ae9-a6b1-eeebdb5ba72a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:43.815765 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87488f8-1ccd-4ae9-a6b1-eeebdb5ba72a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:43.816049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87488f8-1ccd-4ae9-a6b1-eeebdb5ba72a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:43.825607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87488f8-1ccd-4ae9-a6b1-eeebdb5ba72a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:43.828436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87488f8-1ccd-4ae9-a6b1-eeebdb5ba72a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-d87488f8-1ccd-4ae9-a6b1-eeebdb5ba72a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:43.841564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:43.847836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:43.848896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:43.848896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:43.848896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:43.848896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:43.848896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:43.848896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:43.848896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:43.848896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:43.849347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd6fe9-c12b-4d86-bed4-f40d999cbd60 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:43.849427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 376/754] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:43.849427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87488f8-1ccd-4ae9-a6b1-eeebdb5ba72a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:43.865824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:43.895291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc30ef3-c178-4cc4-8095-731905fb3adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:43.895931 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc30ef3-c178-4cc4-8095-731905fb3adf None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:43.902682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc30ef3-c178-4cc4-8095-731905fb3adf None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:43.902682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc30ef3-c178-4cc4-8095-731905fb3adf None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:43.902682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc30ef3-c178-4cc4-8095-731905fb3adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:43.902682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc30ef3-c178-4cc4-8095-731905fb3adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:43.902682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc30ef3-c178-4cc4-8095-731905fb3adf None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:43.919467 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 379/755] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:43.921234 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899b05c-b0b2-4e02-b0a1-4b2fcb686ff1 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:43.921721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899b05c-b0b2-4e02-b0a1-4b2fcb686ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:43.922209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899b05c-b0b2-4e02-b0a1-4b2fcb686ff1 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:43.923895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 380/756] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:43.924749 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899b05c-b0b2-4e02-b0a1-4b2fcb686ff1 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:43.999947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:44.007700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87488f8-1ccd-4ae9-a6b1-eeebdb5ba72a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:44.046704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da5205-6880-4f5b-81fb-0b9616a02a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:44.047333 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da5205-6880-4f5b-81fb-0b9616a02a50 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:44.047615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da5205-6880-4f5b-81fb-0b9616a02a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:44.047889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da5205-6880-4f5b-81fb-0b9616a02a50 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:44.048673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da5205-6880-4f5b-81fb-0b9616a02a50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:44.048982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da5205-6880-4f5b-81fb-0b9616a02a50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:44.050499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da5205-6880-4f5b-81fb-0b9616a02a50 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:44.055800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899b05c-b0b2-4e02-b0a1-4b2fcb686ff1 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:44.066904 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 377/757] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:44.067771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da5205-6880-4f5b-81fb-0b9616a02a50 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:44.107105 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5757e-9e56-4afd-85e9-e09eea7d9121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:44.108888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5757e-9e56-4afd-85e9-e09eea7d9121 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:44.109322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5757e-9e56-4afd-85e9-e09eea7d9121 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:44.109784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5757e-9e56-4afd-85e9-e09eea7d9121 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:44.111686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5757e-9e56-4afd-85e9-e09eea7d9121 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:44.112182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5757e-9e56-4afd-85e9-e09eea7d9121 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:44.113786 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5757e-9e56-4afd-85e9-e09eea7d9121 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:44.130773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 381/758] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:44.132605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110de83-782a-4995-94a4-15ed310d2ef2 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:44.133205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110de83-782a-4995-94a4-15ed310d2ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:44.134051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110de83-782a-4995-94a4-15ed310d2ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:44.157898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-5110de83-782a-4995-94a4-15ed310d2ef2 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:44.159598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5110de83-782a-4995-94a4-15ed310d2ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:44.183398 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da5205-6880-4f5b-81fb-0b9616a02a50 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:44.196571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:44.230886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0cb9d-ed14-4f67-9bae-30e50a288d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:44.231554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0cb9d-ed14-4f67-9bae-30e50a288d8c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:44.231997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0cb9d-ed14-4f67-9bae-30e50a288d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:44.232280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0cb9d-ed14-4f67-9bae-30e50a288d8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:44.242609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0cb9d-ed14-4f67-9bae-30e50a288d8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:44.254232 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0cb9d-ed14-4f67-9bae-30e50a288d8c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:44.254436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 382/759] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:44.254436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110de83-782a-4995-94a4-15ed310d2ef2 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-6fa0cb9d-ed14-4f67-9bae-30e50a288d8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:44.271800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:44.272840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:44.273817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:44.273817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:44.273817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:44.273817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:44.273817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:44.273817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:44.273817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:44.273817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:44.273817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:44.273817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:44.274387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 378/760] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 08:10:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:44.276469 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0cb9d-ed14-4f67-9bae-30e50a288d8c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:44.301466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:44.376959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110de83-782a-4995-94a4-15ed310d2ef2 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:44.397000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0cb9d-ed14-4f67-9bae-30e50a288d8c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:44.417517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa40bcc-a8e5-4a4a-9199-1e7cc9d31e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:44.418185 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40bcc-a8e5-4a4a-9199-1e7cc9d31e16 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:44.418469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40bcc-a8e5-4a4a-9199-1e7cc9d31e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:44.418747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa40bcc-a8e5-4a4a-9199-1e7cc9d31e16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:44.419556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa40bcc-a8e5-4a4a-9199-1e7cc9d31e16 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=e02b653d2f5e4faca2906b2fbd1bfc5c) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:44.419871 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa40bcc-a8e5-4a4a-9199-1e7cc9d31e16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:44.421858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa40bcc-a8e5-4a4a-9199-1e7cc9d31e16 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:44.428368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 383/761] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:44 2022] GET /identity/v3/role_assignments?user.id=e02b653d2f5e4faca2906b2fbd1bfc5c&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:44.431198 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa40bcc-a8e5-4a4a-9199-1e7cc9d31e16 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:44.442412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ffca3-3f8c-4c04-ae47-61ac98222bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:44.443133 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ffca3-3f8c-4c04-ae47-61ac98222bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:44.443529 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ffca3-3f8c-4c04-ae47-61ac98222bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:44.443891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ffca3-3f8c-4c04-ae47-61ac98222bc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:44.444831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ffca3-3f8c-4c04-ae47-61ac98222bc2 None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=ad48c627d5d142489f40584eea36a17f) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:44.445307 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ffca3-3f8c-4c04-ae47-61ac98222bc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:44.446933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ffca3-3f8c-4c04-ae47-61ac98222bc2 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:44.453903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 379/762] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:44 2022] GET /identity/v3/role_assignments?user.id=ad48c627d5d142489f40584eea36a17f&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:44.455285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ffca3-3f8c-4c04-ae47-61ac98222bc2 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:44.490126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:44.580107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:44.590490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa40bcc-a8e5-4a4a-9199-1e7cc9d31e16 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:44.603586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ffca3-3f8c-4c04-ae47-61ac98222bc2 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:44.664594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a85033-5678-4fe4-ac09-a02b98f1fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:44.665250 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a85033-5678-4fe4-ac09-a02b98f1fb97 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:44.665778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a85033-5678-4fe4-ac09-a02b98f1fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:44.666081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a85033-5678-4fe4-ac09-a02b98f1fb97 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:44.666916 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a85033-5678-4fe4-ac09-a02b98f1fb97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:44.667280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a85033-5678-4fe4-ac09-a02b98f1fb97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:44.668838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a85033-5678-4fe4-ac09-a02b98f1fb97 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:44.685508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3cc7-0c7a-45b6-a53e-110497d26c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:44.686595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3cc7-0c7a-45b6-a53e-110497d26c4e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:44.686880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3cc7-0c7a-45b6-a53e-110497d26c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:44.687157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3cc7-0c7a-45b6-a53e-110497d26c4e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:44.687870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d3cc7-0c7a-45b6-a53e-110497d26c4e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:44.690813 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d3cc7-0c7a-45b6-a53e-110497d26c4e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:44.708441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 380/763] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 08:10:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-f18d3cc7-0c7a-45b6-a53e-110497d26c4e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:44.715292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:44.716305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:44.717161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 384/764] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Aug 2 08:10:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:44.720277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a85033-5678-4fe4-ac09-a02b98f1fb97 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:44.725197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3cc7-0c7a-45b6-a53e-110497d26c4e None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:44.914412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:44.925372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3cc7-0c7a-45b6-a53e-110497d26c4e None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:44.985313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a85033-5678-4fe4-ac09-a02b98f1fb97 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:45.042533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121f9c0-bdc0-456b-acc0-637036b2ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:45.043155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121f9c0-bdc0-456b-acc0-637036b2ff9f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:45.043435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121f9c0-bdc0-456b-acc0-637036b2ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:45.043803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121f9c0-bdc0-456b-acc0-637036b2ff9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:45.046802 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f72c6-d9b3-40ec-8b17-d14b5863e76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:45.047456 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f72c6-d9b3-40ec-8b17-d14b5863e76b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:45.047742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f72c6-d9b3-40ec-8b17-d14b5863e76b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:45.048021 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f72c6-d9b3-40ec-8b17-d14b5863e76b None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:45.048733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f72c6-d9b3-40ec-8b17-d14b5863e76b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:45.049043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f72c6-d9b3-40ec-8b17-d14b5863e76b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:45.050478 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f72c6-d9b3-40ec-8b17-d14b5863e76b None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:45.051599 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:45.056249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121f9c0-bdc0-456b-acc0-637036b2ff9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:45.057988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121f9c0-bdc0-456b-acc0-637036b2ff9f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:45.060643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 385/765] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 08:10:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:45.067571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f72c6-d9b3-40ec-8b17-d14b5863e76b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-7121f9c0-bdc0-456b-acc0-637036b2ff9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:45.085477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:45.086783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:45.087777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:45.087777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:45.087777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:45.087777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:45.087777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 381/766] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:45.094971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121f9c0-bdc0-456b-acc0-637036b2ff9f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:45.214952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121f9c0-bdc0-456b-acc0-637036b2ff9f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:45.252504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52653b57-a3d9-44d4-b0dd-86ca0185136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:45.253090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52653b57-a3d9-44d4-b0dd-86ca0185136f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:45.253378 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52653b57-a3d9-44d4-b0dd-86ca0185136f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:45.253651 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52653b57-a3d9-44d4-b0dd-86ca0185136f None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:45.254383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52653b57-a3d9-44d4-b0dd-86ca0185136f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:45.254683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52653b57-a3d9-44d4-b0dd-86ca0185136f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:45.262180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52653b57-a3d9-44d4-b0dd-86ca0185136f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:45.270314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f72c6-d9b3-40ec-8b17-d14b5863e76b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:45.270627 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 382/767] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:45.278154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52653b57-a3d9-44d4-b0dd-86ca0185136f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:45.355359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d589ef-c722-41f5-a3f4-e77fc360c314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:45.356373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d589ef-c722-41f5-a3f4-e77fc360c314 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:45.356804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d589ef-c722-41f5-a3f4-e77fc360c314 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:45.357516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d589ef-c722-41f5-a3f4-e77fc360c314 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:45.367087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d589ef-c722-41f5-a3f4-e77fc360c314 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:45.367087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d589ef-c722-41f5-a3f4-e77fc360c314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:45.367087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d589ef-c722-41f5-a3f4-e77fc360c314 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:45.386073 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 386/768] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 08:10:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:45.393477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:45.401659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d589ef-c722-41f5-a3f4-e77fc360c314 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:45.454424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:45.513988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52653b57-a3d9-44d4-b0dd-86ca0185136f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:45.569084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d589ef-c722-41f5-a3f4-e77fc360c314 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:45.613091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97853ce3-a2f4-42e5-adb4-dc0304f61803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:45.613761 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853ce3-a2f4-42e5-adb4-dc0304f61803 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:45.614067 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853ce3-a2f4-42e5-adb4-dc0304f61803 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:45.614354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853ce3-a2f4-42e5-adb4-dc0304f61803 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:45.626524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97853ce3-a2f4-42e5-adb4-dc0304f61803 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:45.628010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97853ce3-a2f4-42e5-adb4-dc0304f61803 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:45.636108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f4dc8-c65e-4654-a251-226cd884e873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:45.637033 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4dc8-c65e-4654-a251-226cd884e873 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:45.637494 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4dc8-c65e-4654-a251-226cd884e873 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:45.637947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4dc8-c65e-4654-a251-226cd884e873 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:45.639154 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f4dc8-c65e-4654-a251-226cd884e873 None admin] RBAC: Adding query filter params (interface=public, service_id=7c837de2ea4b4bda81763e772f9d8d42, region_id=RegionOne) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:45.639905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f4dc8-c65e-4654-a251-226cd884e873 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-97853ce3-a2f4-42e5-adb4-dc0304f61803 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:45.641216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:45.646630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:45.647662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:45.647662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:45.647662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:45.647662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:45.647662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:45.647662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:45.647662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:45.647662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:45.647662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 383/769] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:45.649831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97853ce3-a2f4-42e5-adb4-dc0304f61803 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:45.650496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f4dc8-c65e-4654-a251-226cd884e873 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:45.671606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 387/770] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 08:10:45 2022] GET /identity/v3/endpoints?service_id=7c837de2ea4b4bda81763e772f9d8d42&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:45.677986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f4dc8-c65e-4654-a251-226cd884e873 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:45.819885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97853ce3-a2f4-42e5-adb4-dc0304f61803 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:45.832462 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:45.842592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:45.861228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f4dc8-c65e-4654-a251-226cd884e873 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:45.865667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6ba5e-a2a4-4ac5-96c0-22f93deeecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:45.866575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6ba5e-a2a4-4ac5-96c0-22f93deeecf7 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:45.867041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6ba5e-a2a4-4ac5-96c0-22f93deeecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:45.867498 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6ba5e-a2a4-4ac5-96c0-22f93deeecf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:45.868500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6ba5e-a2a4-4ac5-96c0-22f93deeecf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:45.869021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6ba5e-a2a4-4ac5-96c0-22f93deeecf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:45.870895 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6ba5e-a2a4-4ac5-96c0-22f93deeecf7 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:45.885688 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 384/771] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:45.892416 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5e6d3-415d-492a-97b8-797e1120a952 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:45.893006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5e6d3-415d-492a-97b8-797e1120a952 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:45.893486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5e6d3-415d-492a-97b8-797e1120a952 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:45.895329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 385/772] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:45.896575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5e6d3-415d-492a-97b8-797e1120a952 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:45.913097 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be746a-7c80-4ae1-b401-30dbca91ea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:45.914504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be746a-7c80-4ae1-b401-30dbca91ea64 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:45.916110 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be746a-7c80-4ae1-b401-30dbca91ea64 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:45.916886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be746a-7c80-4ae1-b401-30dbca91ea64 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:45.917816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be746a-7c80-4ae1-b401-30dbca91ea64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:45.920278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be746a-7c80-4ae1-b401-30dbca91ea64 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:45.929812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 388/773] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 08:10:45 2022] GET /identity/v3/services => generated 772 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:45.938706 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0fd4-1cfa-4524-a7d3-0c6a449f3c43 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:45.941317 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0fd4-1cfa-4524-a7d3-0c6a449f3c43 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:45.941622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0fd4-1cfa-4524-a7d3-0c6a449f3c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:45.995209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-3acb0fd4-1cfa-4524-a7d3-0c6a449f3c43 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:45.996447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3acb0fd4-1cfa-4524-a7d3-0c6a449f3c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:46.134645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5e6d3-415d-492a-97b8-797e1120a952 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:46.176123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 389/774] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:46.200084 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525e456-8ca5-41b6-ab41-46aba2e3ebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:46.201711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525e456-8ca5-41b6-ab41-46aba2e3ebb4 None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:46.202480 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525e456-8ca5-41b6-ab41-46aba2e3ebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:46.203230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525e456-8ca5-41b6-ab41-46aba2e3ebb4 None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/93143507a8784a30bc6b4a5e1f24f0b6/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:46.207646 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525e456-8ca5-41b6-ab41-46aba2e3ebb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=93143507a8784a30bc6b4a5e1f24f0b6, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:46.210694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525e456-8ca5-41b6-ab41-46aba2e3ebb4 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:46.235717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 386/775] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:10:45 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/93143507a8784a30bc6b4a5e1f24f0b6/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:10:46.238864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0fd4-1cfa-4524-a7d3-0c6a449f3c43 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:46.346838 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:46.372492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0fd4-1cfa-4524-a7d3-0c6a449f3c43 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:46.413886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3f00-a946-464c-8a4b-f909f5a80cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:46.414526 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3f00-a946-464c-8a4b-f909f5a80cad None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:46.414812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3f00-a946-464c-8a4b-f909f5a80cad None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:46.416722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3f00-a946-464c-8a4b-f909f5a80cad None admin] PATH_INFO: `/v3/services/network` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:46.417403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b3f00-a946-464c-8a4b-f909f5a80cad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:46.418986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b3f00-a946-464c-8a4b-f909f5a80cad None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-fe1b3f00-a946-464c-8a4b-f909f5a80cad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:46.429100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:46.431036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:46.432642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 390/776] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:46 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:46.439866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525e456-8ca5-41b6-ab41-46aba2e3ebb4 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:46.524222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:46.622997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525e456-8ca5-41b6-ab41-46aba2e3ebb4 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:46.671059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc63c14-228a-406d-b884-128ba3c2d32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:46.671977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc63c14-228a-406d-b884-128ba3c2d32b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:46.672410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc63c14-228a-406d-b884-128ba3c2d32b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:46.672833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc63c14-228a-406d-b884-128ba3c2d32b None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:46.673704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc63c14-228a-406d-b884-128ba3c2d32b None admin] RBAC: Adding query filter params (name=network) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:46.674237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc63c14-228a-406d-b884-128ba3c2d32b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:46.675789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc63c14-228a-406d-b884-128ba3c2d32b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:46.681641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 387/777] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:10:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:46.691133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3f00-a946-464c-8a4b-f909f5a80cad None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:46.857735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3f00-a946-464c-8a4b-f909f5a80cad None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:46.914319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9a7a4-f3ac-42bd-aeca-961454423ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:46.915580 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a7a4-f3ac-42bd-aeca-961454423ebc None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:46.916091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a7a4-f3ac-42bd-aeca-961454423ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:46.916570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a7a4-f3ac-42bd-aeca-961454423ebc None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:46.917564 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9a7a4-f3ac-42bd-aeca-961454423ebc None admin] RBAC: Adding query filter params (type=network) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:46.918107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9a7a4-f3ac-42bd-aeca-961454423ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:46.919701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9a7a4-f3ac-42bd-aeca-961454423ebc None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:46.931429 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 391/778] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:10:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:46.937486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc63c14-228a-406d-b884-128ba3c2d32b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:47.041758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:47.049716 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc63c14-228a-406d-b884-128ba3c2d32b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:47.064584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f39ad3-a6ea-419a-8660-a3fe3e70d037 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:47.064911 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f39ad3-a6ea-419a-8660-a3fe3e70d037 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:47.065137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f39ad3-a6ea-419a-8660-a3fe3e70d037 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:47.066792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 392/779] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:47.075129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76fe24-fa2a-4df6-bf7b-54bb71138049 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:47.075423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76fe24-fa2a-4df6-bf7b-54bb71138049 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:47.075686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76fe24-fa2a-4df6-bf7b-54bb71138049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:47.097775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:47.104057 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-be76fe24-fa2a-4df6-bf7b-54bb71138049 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:47.105530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-be76fe24-fa2a-4df6-bf7b-54bb71138049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:47.119721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad76d3d-f721-420c-b851-4264f9c9e061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:47.120376 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76d3d-f721-420c-b851-4264f9c9e061 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:47.120663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76d3d-f721-420c-b851-4264f9c9e061 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:47.120942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad76d3d-f721-420c-b851-4264f9c9e061 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:47.121812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad76d3d-f721-420c-b851-4264f9c9e061 None admin] RBAC: Adding query filter params (interface=public, service_id=0a9327c51f5b435193603b6872834024, region_id=RegionOne) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:47.122238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad76d3d-f721-420c-b851-4264f9c9e061 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:47.123773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad76d3d-f721-420c-b851-4264f9c9e061 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:47.138046 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 388/780] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 08:10:46 2022] GET /identity/v3/endpoints?service_id=0a9327c51f5b435193603b6872834024&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:47.140307 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1680-0d2d-46b7-90ab-82e4e2f99a41 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:47.140726 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1680-0d2d-46b7-90ab-82e4e2f99a41 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:47.141005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a1680-0d2d-46b7-90ab-82e4e2f99a41 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:47.147135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 389/781] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:47.148141 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a1680-0d2d-46b7-90ab-82e4e2f99a41 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:47.189074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 393/782] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:47.190318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6682b4-94cd-4eae-8ce1-20fcd63a060c None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:47.190598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6682b4-94cd-4eae-8ce1-20fcd63a060c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:47.190871 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6682b4-94cd-4eae-8ce1-20fcd63a060c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:47.220650 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-7c6682b4-94cd-4eae-8ce1-20fcd63a060c None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:47.221843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7c6682b4-94cd-4eae-8ce1-20fcd63a060c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:47.281918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a1680-0d2d-46b7-90ab-82e4e2f99a41 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:47.295730 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 394/783] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:47.296646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6682b4-94cd-4eae-8ce1-20fcd63a060c None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:47.345600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db3eb3-6901-45db-8660-b2200d4c4c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:47.346261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3eb3-6901-45db-8660-b2200d4c4c7a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:47.346609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3eb3-6901-45db-8660-b2200d4c4c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:47.346890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3eb3-6901-45db-8660-b2200d4c4c7a None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:47.358796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db3eb3-6901-45db-8660-b2200d4c4c7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:47.360558 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db3eb3-6901-45db-8660-b2200d4c4c7a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:47.367843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 390/784] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 08:10:47 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:47.369055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db3eb3-6901-45db-8660-b2200d4c4c7a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:47.382949 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:47.402190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:47.433255 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6682b4-94cd-4eae-8ce1-20fcd63a060c None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:47.476418 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eee6ee-5da2-4aa0-8698-41d7a8ba7c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:47.477002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eee6ee-5da2-4aa0-8698-41d7a8ba7c6f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:47.477281 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eee6ee-5da2-4aa0-8698-41d7a8ba7c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:47.477624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eee6ee-5da2-4aa0-8698-41d7a8ba7c6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:47.489932 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eee6ee-5da2-4aa0-8698-41d7a8ba7c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-07eee6ee-5da2-4aa0-8698-41d7a8ba7c6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:47.495806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:47.497034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:47.498119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 395/785] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:47.509298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eee6ee-5da2-4aa0-8698-41d7a8ba7c6f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:47.528734 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db3eb3-6901-45db-8660-b2200d4c4c7a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:47.592554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86cc7f-0007-4abe-97db-5da9bccd13c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:47.593668 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86cc7f-0007-4abe-97db-5da9bccd13c2 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:47.594187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86cc7f-0007-4abe-97db-5da9bccd13c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:47.594612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86cc7f-0007-4abe-97db-5da9bccd13c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:47.608869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86cc7f-0007-4abe-97db-5da9bccd13c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-bb86cc7f-0007-4abe-97db-5da9bccd13c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:47.616656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:47.618375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:47.619897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:47.624915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 391/786] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:47.630703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86cc7f-0007-4abe-97db-5da9bccd13c2 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:47.638967 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eee6ee-5da2-4aa0-8698-41d7a8ba7c6f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:47.670393 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:47.681841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5acf4e-fd26-459a-bfa5-0b5a793aa44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:47.682923 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5acf4e-fd26-459a-bfa5-0b5a793aa44d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:47.682923 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5acf4e-fd26-459a-bfa5-0b5a793aa44d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:47.683080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5acf4e-fd26-459a-bfa5-0b5a793aa44d None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:47.683867 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5acf4e-fd26-459a-bfa5-0b5a793aa44d None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:47.684237 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5acf4e-fd26-459a-bfa5-0b5a793aa44d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:47.685613 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5acf4e-fd26-459a-bfa5-0b5a793aa44d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:47.702136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 396/787] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:47.706996 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5acf4e-fd26-459a-bfa5-0b5a793aa44d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:47.755595 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:47.777821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86cc7f-0007-4abe-97db-5da9bccd13c2 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:47.856038 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5acf4e-fd26-459a-bfa5-0b5a793aa44d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:47.899872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e271d-07fd-4280-b55d-48a708074217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:47.901191 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d231f-85a8-476f-937a-fcde4e92fa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:47.901825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d231f-85a8-476f-937a-fcde4e92fa58 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:47.902124 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d231f-85a8-476f-937a-fcde4e92fa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:47.902398 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d231f-85a8-476f-937a-fcde4e92fa58 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:47.903127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d231f-85a8-476f-937a-fcde4e92fa58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:47.903431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d231f-85a8-476f-937a-fcde4e92fa58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:47.904822 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d231f-85a8-476f-937a-fcde4e92fa58 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:47.906041 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e271d-07fd-4280-b55d-48a708074217 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:47.906324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e271d-07fd-4280-b55d-48a708074217 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:47.906600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e271d-07fd-4280-b55d-48a708074217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:47.926037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e271d-07fd-4280-b55d-48a708074217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:47.926037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e271d-07fd-4280-b55d-48a708074217 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:47.935214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 392/788] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:47.941900 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d231f-85a8-476f-937a-fcde4e92fa58 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-f77e271d-07fd-4280-b55d-48a708074217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:47.943707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:47.944646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:47.945567 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:47.945567 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:47.945567 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:47.945567 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:47.945567 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 397/789] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:47.951352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e271d-07fd-4280-b55d-48a708074217 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:48.010988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:48.093040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e271d-07fd-4280-b55d-48a708074217 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:48.138613 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4713f4e-2dbb-404a-9995-ec30f2c1b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:48.139277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4713f4e-2dbb-404a-9995-ec30f2c1b12c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:48.140191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4713f4e-2dbb-404a-9995-ec30f2c1b12c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:48.140553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4713f4e-2dbb-404a-9995-ec30f2c1b12c None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:48.141280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4713f4e-2dbb-404a-9995-ec30f2c1b12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:48.141584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4713f4e-2dbb-404a-9995-ec30f2c1b12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:48.143036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4713f4e-2dbb-404a-9995-ec30f2c1b12c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:48.157610 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 398/790] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:48.163409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4713f4e-2dbb-404a-9995-ec30f2c1b12c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:48.258165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d231f-85a8-476f-937a-fcde4e92fa58 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:48.281422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4713f4e-2dbb-404a-9995-ec30f2c1b12c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:48.290630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:48.328450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e8e1-e316-4911-bcde-4cad1bdbf574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:48.329110 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e8e1-e316-4911-bcde-4cad1bdbf574 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:48.329389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e8e1-e316-4911-bcde-4cad1bdbf574 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:48.329660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627e8e1-e316-4911-bcde-4cad1bdbf574 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:48.338099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627e8e1-e316-4911-bcde-4cad1bdbf574 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:48.339884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627e8e1-e316-4911-bcde-4cad1bdbf574 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-f627e8e1-e316-4911-bcde-4cad1bdbf574 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:48.356284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:48.357298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:48.358864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:48.358864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:48.358864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:48.358864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:48.358864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:48.358864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:48.358864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:48.358864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:48.358864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:10:48.358864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:48.358864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 399/791] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 08:10:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:48.366034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e8e1-e316-4911-bcde-4cad1bdbf574 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:48.377409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd49ce0-6001-4762-82c3-82a4d0832233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:48.378375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd49ce0-6001-4762-82c3-82a4d0832233 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:48.378813 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd49ce0-6001-4762-82c3-82a4d0832233 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:48.379291 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd49ce0-6001-4762-82c3-82a4d0832233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:48.399109 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd49ce0-6001-4762-82c3-82a4d0832233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:48.400827 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd49ce0-6001-4762-82c3-82a4d0832233 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:48.411294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-8bd49ce0-6001-4762-82c3-82a4d0832233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:48.431153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:48.432136 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:48.433038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:48.433038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:48.433038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:48.433038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:48.433038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 393/792] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 491 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:48.439144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd49ce0-6001-4762-82c3-82a4d0832233 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:48.490147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627e8e1-e316-4911-bcde-4cad1bdbf574 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:48.534069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d1c1e-728e-44e9-bdf6-7cc3a5d5daad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:48.535714 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d1c1e-728e-44e9-bdf6-7cc3a5d5daad None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:48.536614 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d1c1e-728e-44e9-bdf6-7cc3a5d5daad None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:48.537409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d1c1e-728e-44e9-bdf6-7cc3a5d5daad None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:48.539252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d1c1e-728e-44e9-bdf6-7cc3a5d5daad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:48.540102 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d1c1e-728e-44e9-bdf6-7cc3a5d5daad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:48.544078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d1c1e-728e-44e9-bdf6-7cc3a5d5daad None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:48.580933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 400/793] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 08:10:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:48.591219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d1c1e-728e-44e9-bdf6-7cc3a5d5daad None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:48.607540 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd49ce0-6001-4762-82c3-82a4d0832233 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:48.629727 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:48.694459 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e5a2-47fc-43c2-a653-7580e1b7513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:48.695496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e5a2-47fc-43c2-a653-7580e1b7513c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:48.695956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e5a2-47fc-43c2-a653-7580e1b7513c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:48.696395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501e5a2-47fc-43c2-a653-7580e1b7513c None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:48.697562 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e5a2-47fc-43c2-a653-7580e1b7513c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:48.702066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e5a2-47fc-43c2-a653-7580e1b7513c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:48.702066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501e5a2-47fc-43c2-a653-7580e1b7513c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:48.715310 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 394/794] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:48.721150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e5a2-47fc-43c2-a653-7580e1b7513c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:48.785388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d1c1e-728e-44e9-bdf6-7cc3a5d5daad None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:48.832712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:48.850449 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e1187-2b7e-4fe7-9217-de99ab6a2131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:48.851226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e1187-2b7e-4fe7-9217-de99ab6a2131 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:48.851691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e1187-2b7e-4fe7-9217-de99ab6a2131 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:48.852240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e1187-2b7e-4fe7-9217-de99ab6a2131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:48.865316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e1187-2b7e-4fe7-9217-de99ab6a2131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:48.867932 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e1187-2b7e-4fe7-9217-de99ab6a2131 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-514e1187-2b7e-4fe7-9217-de99ab6a2131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:48.895665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:48.896904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:48.897823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:48.897823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:48.897823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:48.897823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:48.905803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 401/795] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:48.911495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e1187-2b7e-4fe7-9217-de99ab6a2131 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:48.930597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501e5a2-47fc-43c2-a653-7580e1b7513c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:48.975724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae8ff2-eeb0-4c17-b233-a2ef7e1ed597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:48.976393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8ff2-eeb0-4c17-b233-a2ef7e1ed597 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:48.976697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8ff2-eeb0-4c17-b233-a2ef7e1ed597 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:48.977131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae8ff2-eeb0-4c17-b233-a2ef7e1ed597 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:48.986359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae8ff2-eeb0-4c17-b233-a2ef7e1ed597 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:48.987829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae8ff2-eeb0-4c17-b233-a2ef7e1ed597 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-52ae8ff2-eeb0-4c17-b233-a2ef7e1ed597 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:49.001798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:49.003002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:49.003949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:49.003949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:49.003949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:49.003949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:49.003949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:49.003949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:49.003949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:49.003949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:49.003949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:49.003949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:49.004598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 395/796] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:49.006056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a010-9e39-4a0d-8ac7-d7abe246fb02 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.006399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a010-9e39-4a0d-8ac7-d7abe246fb02 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.006750 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a010-9e39-4a0d-8ac7-d7abe246fb02 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.012285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 396/797] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:49.012285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a010-9e39-4a0d-8ac7-d7abe246fb02 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:49.026838 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:49.081098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e1187-2b7e-4fe7-9217-de99ab6a2131 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:49.125725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aba015-2190-4b3b-a9fa-730f0735fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:49.126389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aba015-2190-4b3b-a9fa-730f0735fdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.126667 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aba015-2190-4b3b-a9fa-730f0735fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.126999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aba015-2190-4b3b-a9fa-730f0735fdd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.127763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aba015-2190-4b3b-a9fa-730f0735fdd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:49.128072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aba015-2190-4b3b-a9fa-730f0735fdd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:49.130039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aba015-2190-4b3b-a9fa-730f0735fdd5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:49.148491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 402/798] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:49.149421 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a010-9e39-4a0d-8ac7-d7abe246fb02 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:49.150100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8c3d-66a9-44b4-b89d-25f2c99133bd None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.150406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8c3d-66a9-44b4-b89d-25f2c99133bd None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.150733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c8c3d-66a9-44b4-b89d-25f2c99133bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.168855 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:49.171347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-0e2c8c3d-66a9-44b4-b89d-25f2c99133bd None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:49.172821 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-0e2c8c3d-66a9-44b4-b89d-25f2c99133bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:49.191584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6464b5-0437-4b25-8d75-0d3eb9e6153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:49.192544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6464b5-0437-4b25-8d75-0d3eb9e6153f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.192973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6464b5-0437-4b25-8d75-0d3eb9e6153f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.193390 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6464b5-0437-4b25-8d75-0d3eb9e6153f None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.194414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6464b5-0437-4b25-8d75-0d3eb9e6153f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:49.194955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6464b5-0437-4b25-8d75-0d3eb9e6153f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:49.196762 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6464b5-0437-4b25-8d75-0d3eb9e6153f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:49.218691 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 397/799] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 08:10:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:49.219822 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6464b5-0437-4b25-8d75-0d3eb9e6153f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:49.259031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 403/800] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:49.260506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82409795-59f1-4769-9143-1bd7f582025e None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.260805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82409795-59f1-4769-9143-1bd7f582025e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.261088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82409795-59f1-4769-9143-1bd7f582025e None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.266146 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 404/801] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:49.267007 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82409795-59f1-4769-9143-1bd7f582025e None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:49.337126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:49.340376 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6464b5-0437-4b25-8d75-0d3eb9e6153f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:49.382325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9ab88-4f89-4d55-86fb-8cbbe85b7133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:49.383441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9ab88-4f89-4d55-86fb-8cbbe85b7133 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.383947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9ab88-4f89-4d55-86fb-8cbbe85b7133 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.384447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9ab88-4f89-4d55-86fb-8cbbe85b7133 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.385769 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82409795-59f1-4769-9143-1bd7f582025e None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:49.397195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9ab88-4f89-4d55-86fb-8cbbe85b7133 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:49.400000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9ab88-4f89-4d55-86fb-8cbbe85b7133 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-32a9ab88-4f89-4d55-86fb-8cbbe85b7133 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:49.423579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:49.424554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:49.425479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:49.425479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:49.425479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:49.425479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:49.425479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:49.425479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:49.425479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:49.425479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:49.425920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 398/802] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:49.428140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477b114-aaf8-4e2b-ae2e-4cf65380fbec None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.428657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477b114-aaf8-4e2b-ae2e-4cf65380fbec None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.429161 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477b114-aaf8-4e2b-ae2e-4cf65380fbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.431093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15554-5bb9-4c69-94da-3cc2f14ca6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:49.431805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15554-5bb9-4c69-94da-3cc2f14ca6fe None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.432090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15554-5bb9-4c69-94da-3cc2f14ca6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.432368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a15554-5bb9-4c69-94da-3cc2f14ca6fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.449160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6477b114-aaf8-4e2b-ae2e-4cf65380fbec None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:49.450426 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6477b114-aaf8-4e2b-ae2e-4cf65380fbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:49.454930 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a15554-5bb9-4c69-94da-3cc2f14ca6fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:49.456399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a15554-5bb9-4c69-94da-3cc2f14ca6fe None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-04a15554-5bb9-4c69-94da-3cc2f14ca6fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:49.474597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:49.475768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:49.477147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:49.477147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:49.477147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:49.477147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:49.477147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 405/803] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:49.477147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15554-5bb9-4c69-94da-3cc2f14ca6fe None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:49.486524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:49.534179 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 399/804] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:49.535035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477b114-aaf8-4e2b-ae2e-4cf65380fbec None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:49.612532 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a15554-5bb9-4c69-94da-3cc2f14ca6fe None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:49.632249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:49.658667 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df39047-24ad-4c9d-9bb9-0834b8529a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:49.659316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df39047-24ad-4c9d-9bb9-0834b8529a15 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.659592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df39047-24ad-4c9d-9bb9-0834b8529a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.659870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df39047-24ad-4c9d-9bb9-0834b8529a15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.668739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477b114-aaf8-4e2b-ae2e-4cf65380fbec None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:49.674960 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df39047-24ad-4c9d-9bb9-0834b8529a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-3df39047-24ad-4c9d-9bb9-0834b8529a15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:49.680972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:49.681990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:49.682891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 406/805] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:49.683620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df39047-24ad-4c9d-9bb9-0834b8529a15 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:49.717301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eea34-dbb9-4313-b91b-8dfb0e819d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:49.717841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eea34-dbb9-4313-b91b-8dfb0e819d65 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.718156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eea34-dbb9-4313-b91b-8dfb0e819d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.718457 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eea34-dbb9-4313-b91b-8dfb0e819d65 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.719265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eea34-dbb9-4313-b91b-8dfb0e819d65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:49.719592 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eea34-dbb9-4313-b91b-8dfb0e819d65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:49.721057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eea34-dbb9-4313-b91b-8dfb0e819d65 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:49.733922 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 400/806] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:49.734844 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eea34-dbb9-4313-b91b-8dfb0e819d65 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:49.767257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:49.827742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df39047-24ad-4c9d-9bb9-0834b8529a15 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:49.866127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eea34-dbb9-4313-b91b-8dfb0e819d65 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:49.873068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b965f0a-9b74-4343-97e1-fbeb343df7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:49.874738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b965f0a-9b74-4343-97e1-fbeb343df7fb None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.875396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b965f0a-9b74-4343-97e1-fbeb343df7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.875997 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b965f0a-9b74-4343-97e1-fbeb343df7fb None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.877178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b965f0a-9b74-4343-97e1-fbeb343df7fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:49.877801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b965f0a-9b74-4343-97e1-fbeb343df7fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:49.879948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b965f0a-9b74-4343-97e1-fbeb343df7fb None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:49.896282 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 407/807] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:49.897173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b965f0a-9b74-4343-97e1-fbeb343df7fb None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:49.923028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eda51-4f28-4cdf-8d78-64c35a7942bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:49.923695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eda51-4f28-4cdf-8d78-64c35a7942bf None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:49.924006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eda51-4f28-4cdf-8d78-64c35a7942bf None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:49.924282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eda51-4f28-4cdf-8d78-64c35a7942bf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:49.924922 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32eda51-4f28-4cdf-8d78-64c35a7942bf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:49.926329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32eda51-4f28-4cdf-8d78-64c35a7942bf None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:49.939502 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-e32eda51-4f28-4cdf-8d78-64c35a7942bf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:49.946840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:49.948479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 08:10:49.950175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:49.954871 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 401/808] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Aug 2 08:10:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:49.956246 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eda51-4f28-4cdf-8d78-64c35a7942bf None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:50.025158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b965f0a-9b74-4343-97e1-fbeb343df7fb None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:50.067773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc86db-3c92-4156-be55-07366359e9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:50.068403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc86db-3c92-4156-be55-07366359e9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:50.068688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc86db-3c92-4156-be55-07366359e9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:50.068965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc86db-3c92-4156-be55-07366359e9c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:50.069695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc86db-3c92-4156-be55-07366359e9c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:50.070002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc86db-3c92-4156-be55-07366359e9c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:50.071412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc86db-3c92-4156-be55-07366359e9c5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:50.073407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:50.086465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 408/809] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:50.086465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc86db-3c92-4156-be55-07366359e9c5 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:50.095488 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eda51-4f28-4cdf-8d78-64c35a7942bf None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:50.145513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18690add-3d62-4023-af8a-8b062c7aa2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:50.146544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18690add-3d62-4023-af8a-8b062c7aa2a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:50.146998 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18690add-3d62-4023-af8a-8b062c7aa2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:50.147449 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18690add-3d62-4023-af8a-8b062c7aa2a8 None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/ad48c627d5d142489f40584eea36a17f/roles/64801aebebf743e6b6a4201447a7fe0d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:50.172198 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18690add-3d62-4023-af8a-8b062c7aa2a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=ad48c627d5d142489f40584eea36a17f, role_id=64801aebebf743e6b6a4201447a7fe0d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:50.173629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18690add-3d62-4023-af8a-8b062c7aa2a8 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:50.199024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 402/810] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:10:49 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/ad48c627d5d142489f40584eea36a17f/roles/64801aebebf743e6b6a4201447a7fe0d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:10:50.199615 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:50.199752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18690add-3d62-4023-af8a-8b062c7aa2a8 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:50.217036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc86db-3c92-4156-be55-07366359e9c5 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:50.267677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aa9c9-4d62-49ca-a456-e733adc5ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:50.268347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa9c9-4d62-49ca-a456-e733adc5ed7f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:50.268632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa9c9-4d62-49ca-a456-e733adc5ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:50.268899 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aa9c9-4d62-49ca-a456-e733adc5ed7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:50.281965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aa9c9-4d62-49ca-a456-e733adc5ed7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:50.283518 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aa9c9-4d62-49ca-a456-e733adc5ed7f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-f30aa9c9-4d62-49ca-a456-e733adc5ed7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:50.304794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:50.305794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:50.306741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:50.306741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:50.306741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:50.306741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:50.306741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:50.306741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:50.306741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:50.306741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:50.307187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 409/811] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:50.308208 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aa9c9-4d62-49ca-a456-e733adc5ed7f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:50.334351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18690add-3d62-4023-af8a-8b062c7aa2a8 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:50.385660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29309ee0-395a-4ac2-9613-5144cff60aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:50.386359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29309ee0-395a-4ac2-9613-5144cff60aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:50.386645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29309ee0-395a-4ac2-9613-5144cff60aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:50.386915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29309ee0-395a-4ac2-9613-5144cff60aa1 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:50.387620 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29309ee0-395a-4ac2-9613-5144cff60aa1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:50.387938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29309ee0-395a-4ac2-9613-5144cff60aa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:50.389375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29309ee0-395a-4ac2-9613-5144cff60aa1 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:50.394756 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 403/812] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 08:10:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:50.395961 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5814d2f-c284-4b22-a136-cc54047692b0 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:50.396220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5814d2f-c284-4b22-a136-cc54047692b0 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:50.396515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5814d2f-c284-4b22-a136-cc54047692b0 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:50.397888 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 404/813] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:50.398487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5814d2f-c284-4b22-a136-cc54047692b0 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:50.405971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:50.458777 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aa9c9-4d62-49ca-a456-e733adc5ed7f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:50.498628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcc262-5081-45c3-a32e-bc780777eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:50.499548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcc262-5081-45c3-a32e-bc780777eb91 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:50.499983 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcc262-5081-45c3-a32e-bc780777eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:50.500408 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcc262-5081-45c3-a32e-bc780777eb91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:50.514950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcc262-5081-45c3-a32e-bc780777eb91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:50.517879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdcc262-5081-45c3-a32e-bc780777eb91 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:50.532847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5814d2f-c284-4b22-a136-cc54047692b0 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-2cdcc262-5081-45c3-a32e-bc780777eb91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:50.535841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:50.536897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:50.538737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:50.538737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:50.538737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:50.538737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:50.538737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 410/814] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:50.538737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcc262-5081-45c3-a32e-bc780777eb91 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:50.549274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:50.587582 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2705cf-4009-43b9-9438-fd92c6c90da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:50.588215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2705cf-4009-43b9-9438-fd92c6c90da7 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:50.588505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2705cf-4009-43b9-9438-fd92c6c90da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:50.589106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2705cf-4009-43b9-9438-fd92c6c90da7 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:50.589537 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2705cf-4009-43b9-9438-fd92c6c90da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:50.589942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2705cf-4009-43b9-9438-fd92c6c90da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:50.591316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2705cf-4009-43b9-9438-fd92c6c90da7 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:50.609373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 405/815] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:50.610118 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8c706-e09e-47ea-abb3-de605b12e233 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:50.610447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8c706-e09e-47ea-abb3-de605b12e233 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:50.610683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8c706-e09e-47ea-abb3-de605b12e233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:50.632970 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-14a8c706-e09e-47ea-abb3-de605b12e233 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:50.634236 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-14a8c706-e09e-47ea-abb3-de605b12e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:50.664545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcc262-5081-45c3-a32e-bc780777eb91 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:50.710943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:50.716742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c22e97-eaf5-44c5-a0e6-8db49c1cca74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:50.717922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c22e97-eaf5-44c5-a0e6-8db49c1cca74 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:50.718370 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c22e97-eaf5-44c5-a0e6-8db49c1cca74 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:50.718863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c22e97-eaf5-44c5-a0e6-8db49c1cca74 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:50.719600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c22e97-eaf5-44c5-a0e6-8db49c1cca74 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:50.719927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c22e97-eaf5-44c5-a0e6-8db49c1cca74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:50.721309 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c22e97-eaf5-44c5-a0e6-8db49c1cca74 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:50.734506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 411/816] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 08:10:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:50.734506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c22e97-eaf5-44c5-a0e6-8db49c1cca74 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:50.734796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 406/817] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:50.734796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8c706-e09e-47ea-abb3-de605b12e233 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:50.829076 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:50.859556 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8c706-e09e-47ea-abb3-de605b12e233 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:50.865910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c22e97-eaf5-44c5-a0e6-8db49c1cca74 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:50.909529 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfe39e-41ff-4781-9c61-d62dad44c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:50.910274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe39e-41ff-4781-9c61-d62dad44c6d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:50.910530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe39e-41ff-4781-9c61-d62dad44c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:50.910807 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe39e-41ff-4781-9c61-d62dad44c6d6 None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/e02b653d2f5e4faca2906b2fbd1bfc5c/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:50.913131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfe39e-41ff-4781-9c61-d62dad44c6d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=e02b653d2f5e4faca2906b2fbd1bfc5c, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:50.914949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfe39e-41ff-4781-9c61-d62dad44c6d6 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:50.920929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c98fe-245d-4fff-925b-cd4dbd8eea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:50.921572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c98fe-245d-4fff-925b-cd4dbd8eea3c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:50.921857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c98fe-245d-4fff-925b-cd4dbd8eea3c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:50.922173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c98fe-245d-4fff-925b-cd4dbd8eea3c None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:50.923085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c98fe-245d-4fff-925b-cd4dbd8eea3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:50.923423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c98fe-245d-4fff-925b-cd4dbd8eea3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:50.925290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c98fe-245d-4fff-925b-cd4dbd8eea3c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:50.944302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 407/818] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:10:50 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/e02b653d2f5e4faca2906b2fbd1bfc5c/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:10:50.950121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 412/819] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:50.950324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfe39e-41ff-4781-9c61-d62dad44c6d6 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:50.950407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c98fe-245d-4fff-925b-cd4dbd8eea3c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:51.034987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:51.096843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfe39e-41ff-4781-9c61-d62dad44c6d6 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:51.137435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14944a-e046-479d-a9be-2f51389cf54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:51.138100 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14944a-e046-479d-a9be-2f51389cf54a None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:51.138381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14944a-e046-479d-a9be-2f51389cf54a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:51.138485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c98fe-245d-4fff-925b-cd4dbd8eea3c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:51.138746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14944a-e046-479d-a9be-2f51389cf54a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:51.139887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14944a-e046-479d-a9be-2f51389cf54a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:51.141273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14944a-e046-479d-a9be-2f51389cf54a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:51.171601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 408/820] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:10:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:10:51.172563 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14944a-e046-479d-a9be-2f51389cf54a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:51.205381 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:51.234213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6152284-9549-47cc-90d7-b62166ec3436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:51.235309 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6152284-9549-47cc-90d7-b62166ec3436 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:51.235775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6152284-9549-47cc-90d7-b62166ec3436 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:51.236246 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6152284-9549-47cc-90d7-b62166ec3436 None admin] PATH_INFO: `/v3/services/network` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:51.238252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6152284-9549-47cc-90d7-b62166ec3436 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:51.240819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6152284-9549-47cc-90d7-b62166ec3436 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-a6152284-9549-47cc-90d7-b62166ec3436 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:51.261637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:51.262784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:51.263629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 413/821] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:50 2022] GET /identity/v3/services/network => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:51.272624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6152284-9549-47cc-90d7-b62166ec3436 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:51.361173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14944a-e046-479d-a9be-2f51389cf54a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:51.385769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:51.427068 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2813f-0052-4083-8cf3-312a64a1cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:51.427630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2813f-0052-4083-8cf3-312a64a1cd5b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:51.427910 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2813f-0052-4083-8cf3-312a64a1cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:51.428180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2813f-0052-4083-8cf3-312a64a1cd5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:51.447727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2813f-0052-4083-8cf3-312a64a1cd5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:51.451238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2813f-0052-4083-8cf3-312a64a1cd5b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-1ef2813f-0052-4083-8cf3-312a64a1cd5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:51.467879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:51.468889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:51.469839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:51.469839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:51.469839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:51.469839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:51.469839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:51.469839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:51.469839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:51.469839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:51.469839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:10:51.469839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:51.473256 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 409/822] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 08:10:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:51.479128 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2813f-0052-4083-8cf3-312a64a1cd5b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:51.507178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6152284-9549-47cc-90d7-b62166ec3436 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:51.561103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806508da-1069-4466-a8bb-33495e0e8bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:51.562187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806508da-1069-4466-a8bb-33495e0e8bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:51.562676 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806508da-1069-4466-a8bb-33495e0e8bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:51.563164 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806508da-1069-4466-a8bb-33495e0e8bb6 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:51.564320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806508da-1069-4466-a8bb-33495e0e8bb6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:51.564860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806508da-1069-4466-a8bb-33495e0e8bb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:51.566481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806508da-1069-4466-a8bb-33495e0e8bb6 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:51.573547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 414/823] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:10:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:51.579851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806508da-1069-4466-a8bb-33495e0e8bb6 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:51.652654 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2813f-0052-4083-8cf3-312a64a1cd5b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:51.683945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:51.695173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523455a7-d198-4639-8525-db4f3597fdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:51.696087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523455a7-d198-4639-8525-db4f3597fdeb None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:51.696589 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523455a7-d198-4639-8525-db4f3597fdeb None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:51.697072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523455a7-d198-4639-8525-db4f3597fdeb None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:51.698206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523455a7-d198-4639-8525-db4f3597fdeb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:51.698667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523455a7-d198-4639-8525-db4f3597fdeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:51.700453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523455a7-d198-4639-8525-db4f3597fdeb None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:51.723771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 410/824] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 08:10:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:51.729851 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523455a7-d198-4639-8525-db4f3597fdeb None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:51.774252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806508da-1069-4466-a8bb-33495e0e8bb6 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:51.796878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:51.856751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed95924-05ca-4177-9838-9824def32da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:51.857845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed95924-05ca-4177-9838-9824def32da2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:51.858386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed95924-05ca-4177-9838-9824def32da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:51.858873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed95924-05ca-4177-9838-9824def32da2 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:51.860091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed95924-05ca-4177-9838-9824def32da2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:51.860648 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed95924-05ca-4177-9838-9824def32da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:51.862669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed95924-05ca-4177-9838-9824def32da2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:51.881492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 415/825] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:10:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:51.882469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed95924-05ca-4177-9838-9824def32da2 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:51.932523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523455a7-d198-4639-8525-db4f3597fdeb None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:51.982062 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3f22f-28a9-4d9d-867a-58503c886604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:51.983521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f22f-28a9-4d9d-867a-58503c886604 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:51.984448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f22f-28a9-4d9d-867a-58503c886604 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:51.985361 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3f22f-28a9-4d9d-867a-58503c886604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:52.098557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3f22f-28a9-4d9d-867a-58503c886604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:52.100801 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3f22f-28a9-4d9d-867a-58503c886604 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:52.108532 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed95924-05ca-4177-9838-9824def32da2 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:52.147463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:52.155835 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:52.176118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d9192-2c18-4005-83f3-38040e54b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:52.177425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9192-2c18-4005-83f3-38040e54b93a None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:52.177705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9192-2c18-4005-83f3-38040e54b93a None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:52.177979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9192-2c18-4005-83f3-38040e54b93a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:52.178767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d9192-2c18-4005-83f3-38040e54b93a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:52.180189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d9192-2c18-4005-83f3-38040e54b93a None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:52.225979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 416/826] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:10:51 2022] POST /identity/v3/endpoints => generated 337 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:10:52.270775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 411/827] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:10:52.279268 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d9192-2c18-4005-83f3-38040e54b93a None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:52.468348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d9192-2c18-4005-83f3-38040e54b93a None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:52.519730 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104a5c6-7112-4736-8035-4d73cc218b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:52.520504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104a5c6-7112-4736-8035-4d73cc218b7e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:52.520687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104a5c6-7112-4736-8035-4d73cc218b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:52.521050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104a5c6-7112-4736-8035-4d73cc218b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:52.536695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104a5c6-7112-4736-8035-4d73cc218b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:52.538273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104a5c6-7112-4736-8035-4d73cc218b7e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-a104a5c6-7112-4736-8035-4d73cc218b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:52.555320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:52.556279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:52.557180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:52.557180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:52.557180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:52.557180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:52.557180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 417/828] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:52.557906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f716f-03f0-4e25-b2ee-bdf4e4db0582 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:52.557906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f716f-03f0-4e25-b2ee-bdf4e4db0582 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:52.558174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f716f-03f0-4e25-b2ee-bdf4e4db0582 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:52.559566 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 412/829] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:52.565725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104a5c6-7112-4736-8035-4d73cc218b7e None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:52.571260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9175251-6196-4ab6-a9d2-98d6572ff5a6 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:52.571562 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9175251-6196-4ab6-a9d2-98d6572ff5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:52.571824 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9175251-6196-4ab6-a9d2-98d6572ff5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:52.597155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-c9175251-6196-4ab6-a9d2-98d6572ff5a6 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:52.598421 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c9175251-6196-4ab6-a9d2-98d6572ff5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:52.605439 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:52.678289 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 413/830] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:52.700268 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104a5c6-7112-4736-8035-4d73cc218b7e None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:52.703662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9175251-6196-4ab6-a9d2-98d6572ff5a6 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:52.759995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1592418-c652-46d7-828a-bfe926079eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:52.761577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1592418-c652-46d7-828a-bfe926079eef None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:52.762317 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1592418-c652-46d7-828a-bfe926079eef None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:52.762979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1592418-c652-46d7-828a-bfe926079eef None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:52.764494 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1592418-c652-46d7-828a-bfe926079eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:52.765106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:52.766790 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1592418-c652-46d7-828a-bfe926079eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:52.769552 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1592418-c652-46d7-828a-bfe926079eef None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:52.794090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 418/831] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:52.801589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1592418-c652-46d7-828a-bfe926079eef None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:52.821078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9175251-6196-4ab6-a9d2-98d6572ff5a6 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:52.861641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab49fe-9354-46d3-b9b1-fb40f5570a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:52.862333 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab49fe-9354-46d3-b9b1-fb40f5570a59 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:52.862618 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab49fe-9354-46d3-b9b1-fb40f5570a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:52.862921 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab49fe-9354-46d3-b9b1-fb40f5570a59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:52.875141 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab49fe-9354-46d3-b9b1-fb40f5570a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-bdab49fe-9354-46d3-b9b1-fb40f5570a59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:52.880783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:52.882710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:10:52.884724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:52.887993 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 414/832] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:10:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:52.889351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab49fe-9354-46d3-b9b1-fb40f5570a59 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:52.952633 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:52.965759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1592418-c652-46d7-828a-bfe926079eef None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:53.010910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc5cf0-172c-4896-b5b1-9a3bf242777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:53.012168 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc5cf0-172c-4896-b5b1-9a3bf242777f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:53.012683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc5cf0-172c-4896-b5b1-9a3bf242777f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:53.013163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc5cf0-172c-4896-b5b1-9a3bf242777f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:53.022042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc5cf0-172c-4896-b5b1-9a3bf242777f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:53.024390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc5cf0-172c-4896-b5b1-9a3bf242777f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-acdc5cf0-172c-4896-b5b1-9a3bf242777f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:53.038839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:53.039854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:53.041065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:53.041065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:53.041065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:53.041065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:53.041065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:53.041065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:53.041065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:53.041065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:53.043744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 419/833] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:53.043878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab49fe-9354-46d3-b9b1-fb40f5570a59 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:53.052842 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc5cf0-172c-4896-b5b1-9a3bf242777f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:53.068568 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:53.095344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e194251-8180-4aeb-b120-f0f82b5fedb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:53.096115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e194251-8180-4aeb-b120-f0f82b5fedb2 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:53.096352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e194251-8180-4aeb-b120-f0f82b5fedb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:53.096611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e194251-8180-4aeb-b120-f0f82b5fedb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:53.097851 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e194251-8180-4aeb-b120-f0f82b5fedb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:53.098385 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e194251-8180-4aeb-b120-f0f82b5fedb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:53.100224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e194251-8180-4aeb-b120-f0f82b5fedb2 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:53.112415 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 415/834] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:10:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:53.119030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e194251-8180-4aeb-b120-f0f82b5fedb2 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:53.200783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc5cf0-172c-4896-b5b1-9a3bf242777f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:53.245883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e194251-8180-4aeb-b120-f0f82b5fedb2 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:53.250493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b4b12-061c-43d5-a6ef-8ed4eae95b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:53.251464 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b4b12-061c-43d5-a6ef-8ed4eae95b83 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:53.252008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b4b12-061c-43d5-a6ef-8ed4eae95b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:53.252557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b4b12-061c-43d5-a6ef-8ed4eae95b83 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:53.253531 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b4b12-061c-43d5-a6ef-8ed4eae95b83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:53.254735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b4b12-061c-43d5-a6ef-8ed4eae95b83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:53.256934 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b4b12-061c-43d5-a6ef-8ed4eae95b83 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:53.275511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 420/835] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:53.282524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b4b12-061c-43d5-a6ef-8ed4eae95b83 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:53.285643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:53.295365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ab597-2646-45bf-af1a-d6485b08b256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:53.297241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ab597-2646-45bf-af1a-d6485b08b256 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:53.298599 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ab597-2646-45bf-af1a-d6485b08b256 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:53.299412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ab597-2646-45bf-af1a-d6485b08b256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:53.316945 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ab597-2646-45bf-af1a-d6485b08b256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:53.319386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ab597-2646-45bf-af1a-d6485b08b256 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-c94ab597-2646-45bf-af1a-d6485b08b256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:53.339181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:53.340613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:53.341535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:53.341535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:53.341535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:53.341535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:53.346167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 416/836] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:53.347798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ab597-2646-45bf-af1a-d6485b08b256 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:53.383733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:53.416465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b4b12-061c-43d5-a6ef-8ed4eae95b83 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:53.455851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64e6ea-8dc5-4b49-8cb0-ad418ad6dd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:53.456733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64e6ea-8dc5-4b49-8cb0-ad418ad6dd69 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:53.457101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64e6ea-8dc5-4b49-8cb0-ad418ad6dd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:53.457509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64e6ea-8dc5-4b49-8cb0-ad418ad6dd69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:53.458557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64e6ea-8dc5-4b49-8cb0-ad418ad6dd69 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=93143507a8784a30bc6b4a5e1f24f0b6) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:53.458947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64e6ea-8dc5-4b49-8cb0-ad418ad6dd69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:53.461168 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64e6ea-8dc5-4b49-8cb0-ad418ad6dd69 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:53.467833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ab597-2646-45bf-af1a-d6485b08b256 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:53.469298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 421/837] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:53 2022] GET /identity/v3/role_assignments?user.id=93143507a8784a30bc6b4a5e1f24f0b6&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:53.471908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223cb9d-1654-40d1-9a0f-3d133e07bd8e None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:53.472387 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223cb9d-1654-40d1-9a0f-3d133e07bd8e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:53.472849 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223cb9d-1654-40d1-9a0f-3d133e07bd8e None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:53.478787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 422/838] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:53.481109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecc179-6f10-4001-b6df-0252b485d2e3 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:53.481657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecc179-6f10-4001-b6df-0252b485d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:53.482117 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecc179-6f10-4001-b6df-0252b485d2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:53.504938 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-49ecc179-6f10-4001-b6df-0252b485d2e3 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:53.506771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-49ecc179-6f10-4001-b6df-0252b485d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:53.512200 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af72db5-6069-4d92-bd89-8461aed6ab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:53.512992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72db5-6069-4d92-bd89-8461aed6ab71 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:53.513354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72db5-6069-4d92-bd89-8461aed6ab71 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:53.513709 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72db5-6069-4d92-bd89-8461aed6ab71 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:53.515123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af72db5-6069-4d92-bd89-8461aed6ab71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:53.515513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af72db5-6069-4d92-bd89-8461aed6ab71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:53.517079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af72db5-6069-4d92-bd89-8461aed6ab71 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:53.532204 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 417/839] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:53.538875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af72db5-6069-4d92-bd89-8461aed6ab71 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:53.603313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:53.626024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 423/840] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:53.657532 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecc179-6f10-4001-b6df-0252b485d2e3 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:53.715107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:53.730885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af72db5-6069-4d92-bd89-8461aed6ab71 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:53.777632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfa170-ba57-44ee-90ed-61ce1fd1186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:53.779626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfa170-ba57-44ee-90ed-61ce1fd1186b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:53.780095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfa170-ba57-44ee-90ed-61ce1fd1186b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:53.780522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfa170-ba57-44ee-90ed-61ce1fd1186b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:53.792010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfa170-ba57-44ee-90ed-61ce1fd1186b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:53.794940 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfa170-ba57-44ee-90ed-61ce1fd1186b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-8dcfa170-ba57-44ee-90ed-61ce1fd1186b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:53.816208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:53.818066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:53.819373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:53.819373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:53.819373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:53.819373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:53.819373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:53.819373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:53.819373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:53.819373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:53.819373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:10:53.819373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:53.825798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 418/841] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 08:10:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:53.826556 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfa170-ba57-44ee-90ed-61ce1fd1186b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:53.830776 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecc179-6f10-4001-b6df-0252b485d2e3 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:53.893635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4805918-be4c-4eb6-9352-71e7c8493a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:53.894259 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4805918-be4c-4eb6-9352-71e7c8493a46 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:53.894541 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4805918-be4c-4eb6-9352-71e7c8493a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:53.894820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4805918-be4c-4eb6-9352-71e7c8493a46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:53.908866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4805918-be4c-4eb6-9352-71e7c8493a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-b4805918-be4c-4eb6-9352-71e7c8493a46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:53.913959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:53.916090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:10:53.917848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:53.920896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 424/842] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:53.923062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07568514-d97d-401b-ab0f-c9f3c7261ac9 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:53.923558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07568514-d97d-401b-ab0f-c9f3c7261ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:53.923867 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07568514-d97d-401b-ab0f-c9f3c7261ac9 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:53.929399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 425/843] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:53.929399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07568514-d97d-401b-ab0f-c9f3c7261ac9 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:53.977114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfa170-ba57-44ee-90ed-61ce1fd1186b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:54.007746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:54.018811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6434e64-6872-45dd-a6a6-f203d444d4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:54.019534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6434e64-6872-45dd-a6a6-f203d444d4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:54.019928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6434e64-6872-45dd-a6a6-f203d444d4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:54.020791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6434e64-6872-45dd-a6a6-f203d444d4a0 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:54.021270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6434e64-6872-45dd-a6a6-f203d444d4a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:54.021584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6434e64-6872-45dd-a6a6-f203d444d4a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:54.023051 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6434e64-6872-45dd-a6a6-f203d444d4a0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:54.053439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 419/844] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 08:10:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:54.053439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c237-500b-4a68-8e2c-c4912209a30e None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:54.053439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c237-500b-4a68-8e2c-c4912209a30e None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:54.053439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905c237-500b-4a68-8e2c-c4912209a30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:54.070821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-b905c237-500b-4a68-8e2c-c4912209a30e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:54.072059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b905c237-500b-4a68-8e2c-c4912209a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:54.074551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:54.075506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07568514-d97d-401b-ab0f-c9f3c7261ac9 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:54.115544 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2610b-e780-4793-90a4-06d57486703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:54.116157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2610b-e780-4793-90a4-06d57486703c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:54.116473 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2610b-e780-4793-90a4-06d57486703c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:54.116924 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2610b-e780-4793-90a4-06d57486703c None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:54.118211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2610b-e780-4793-90a4-06d57486703c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:54.118606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2610b-e780-4793-90a4-06d57486703c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:54.120611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2610b-e780-4793-90a4-06d57486703c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:54.135804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 426/845] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:54.135804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2610b-e780-4793-90a4-06d57486703c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:54.174138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 420/846] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:54.174138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905c237-500b-4a68-8e2c-c4912209a30e None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:54.258818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2610b-e780-4793-90a4-06d57486703c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:54.282638 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:54.308076 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb08b54-0043-4620-8f4b-70896581a34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:54.308716 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb08b54-0043-4620-8f4b-70896581a34e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:54.309002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb08b54-0043-4620-8f4b-70896581a34e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:54.309283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb08b54-0043-4620-8f4b-70896581a34e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:54.310597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905c237-500b-4a68-8e2c-c4912209a30e None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:54.362128 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cdc3d-031d-44aa-b25e-8229e8c19f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:54.363006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cdc3d-031d-44aa-b25e-8229e8c19f15 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:54.363478 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cdc3d-031d-44aa-b25e-8229e8c19f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:54.363787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cdc3d-031d-44aa-b25e-8229e8c19f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:54.372776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:54.379830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cdc3d-031d-44aa-b25e-8229e8c19f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:54.381675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cdc3d-031d-44aa-b25e-8229e8c19f15 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-a73cdc3d-031d-44aa-b25e-8229e8c19f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:54.399335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:54.400523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:54.401453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:54.401453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:54.401453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:54.401453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:54.401453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 421/847] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:54.401735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cdc3d-031d-44aa-b25e-8229e8c19f15 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:54.424252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb08b54-0043-4620-8f4b-70896581a34e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:54.425640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb08b54-0043-4620-8f4b-70896581a34e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:54.537180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cdc3d-031d-44aa-b25e-8229e8c19f15 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:54.542127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 427/848] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:54 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:10:54.547996 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb08b54-0043-4620-8f4b-70896581a34e None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:54.569422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:54.579288 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060da785-3dee-4b62-b70d-d8ff587065c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:54.580062 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060da785-3dee-4b62-b70d-d8ff587065c4 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:54.580346 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060da785-3dee-4b62-b70d-d8ff587065c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:54.580636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060da785-3dee-4b62-b70d-d8ff587065c4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:54.581362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060da785-3dee-4b62-b70d-d8ff587065c4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:54.582789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060da785-3dee-4b62-b70d-d8ff587065c4 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-060da785-3dee-4b62-b70d-d8ff587065c4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:54.593389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:54.594695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:54.595623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 422/849] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:10:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:54.598936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060da785-3dee-4b62-b70d-d8ff587065c4 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:54.677745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:54.693087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb08b54-0043-4620-8f4b-70896581a34e None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:54.744629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060da785-3dee-4b62-b70d-d8ff587065c4 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:54.748534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00745f-eda1-446e-b985-cf365cce87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:54.748959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00745f-eda1-446e-b985-cf365cce87a6 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:54.749245 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00745f-eda1-446e-b985-cf365cce87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:54.749520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00745f-eda1-446e-b985-cf365cce87a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:54.750253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00745f-eda1-446e-b985-cf365cce87a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:54.750556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00745f-eda1-446e-b985-cf365cce87a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:54.751973 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00745f-eda1-446e-b985-cf365cce87a6 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:54.765757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 428/850] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:54.767389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00745f-eda1-446e-b985-cf365cce87a6 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:54.804769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad4b03-4d62-4963-9f62-ab75efa646ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:54.805856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad4b03-4d62-4963-9f62-ab75efa646ff None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:54.806815 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad4b03-4d62-4963-9f62-ab75efa646ff None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:54.807139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad4b03-4d62-4963-9f62-ab75efa646ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:54.820350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad4b03-4d62-4963-9f62-ab75efa646ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:54.821819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad4b03-4d62-4963-9f62-ab75efa646ff None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-c0ad4b03-4d62-4963-9f62-ab75efa646ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:54.840607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:54.842674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:54.843658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:54.843658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:54.843658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:54.843658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:54.843658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 423/851] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:54.843658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad4b03-4d62-4963-9f62-ab75efa646ff None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:54.889368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:54.924194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00745f-eda1-446e-b985-cf365cce87a6 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:54.978889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad4b03-4d62-4963-9f62-ab75efa646ff None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:54.984086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fe157-1c67-45e2-bb42-8437b567065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:54.985269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe157-1c67-45e2-bb42-8437b567065d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:54.985824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe157-1c67-45e2-bb42-8437b567065d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:54.986412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe157-1c67-45e2-bb42-8437b567065d None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:54.987696 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fe157-1c67-45e2-bb42-8437b567065d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:54.988137 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:54.988442 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fe157-1c67-45e2-bb42-8437b567065d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:54.991599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fe157-1c67-45e2-bb42-8437b567065d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:55.000025 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 429/852] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:10:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:55.000869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fe157-1c67-45e2-bb42-8437b567065d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:55.037857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c951b-e56e-4acd-8b37-a4824ce1960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:55.038546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c951b-e56e-4acd-8b37-a4824ce1960d None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:55.038831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c951b-e56e-4acd-8b37-a4824ce1960d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:55.039106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c951b-e56e-4acd-8b37-a4824ce1960d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:55.048007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c951b-e56e-4acd-8b37-a4824ce1960d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:55.049477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c951b-e56e-4acd-8b37-a4824ce1960d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-118c951b-e56e-4acd-8b37-a4824ce1960d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:55.064348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:55.066490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 424/853] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:10:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:55.068671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c951b-e56e-4acd-8b37-a4824ce1960d None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:55.157680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fe157-1c67-45e2-bb42-8437b567065d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:55.217951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcdac5-d3f3-4030-812b-56c268e9c5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:55.219062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcdac5-d3f3-4030-812b-56c268e9c5fd None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:55.219524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcdac5-d3f3-4030-812b-56c268e9c5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:55.219959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcdac5-d3f3-4030-812b-56c268e9c5fd None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:55.221132 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcdac5-d3f3-4030-812b-56c268e9c5fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:55.221648 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcdac5-d3f3-4030-812b-56c268e9c5fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:55.224136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcdac5-d3f3-4030-812b-56c268e9c5fd None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:55.236759 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c951b-e56e-4acd-8b37-a4824ce1960d None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:55.246212 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 430/854] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:55.246936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcdac5-d3f3-4030-812b-56c268e9c5fd None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:55.250785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:55.283502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9352f3c-4577-42b1-9499-5940e2f7a635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:55.284233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9352f3c-4577-42b1-9499-5940e2f7a635 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:55.284516 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9352f3c-4577-42b1-9499-5940e2f7a635 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:55.284795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9352f3c-4577-42b1-9499-5940e2f7a635 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:55.285491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9352f3c-4577-42b1-9499-5940e2f7a635 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:55.285798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9352f3c-4577-42b1-9499-5940e2f7a635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:55.287262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9352f3c-4577-42b1-9499-5940e2f7a635 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:55.292669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 425/855] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:10:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:55.293502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9352f3c-4577-42b1-9499-5940e2f7a635 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:55.350773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:55.429615 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcdac5-d3f3-4030-812b-56c268e9c5fd None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:55.491106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b9c0f-067b-48f0-b2a8-d63ecc7ec2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:55.491703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b9c0f-067b-48f0-b2a8-d63ecc7ec2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:55.492023 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b9c0f-067b-48f0-b2a8-d63ecc7ec2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:55.492298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b9c0f-067b-48f0-b2a8-d63ecc7ec2d7 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:55.493261 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b9c0f-067b-48f0-b2a8-d63ecc7ec2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:55.493626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b9c0f-067b-48f0-b2a8-d63ecc7ec2d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:55.495515 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b9c0f-067b-48f0-b2a8-d63ecc7ec2d7 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:55.499899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9352f3c-4577-42b1-9499-5940e2f7a635 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:55.527658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 431/856] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 08:10:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:55.536345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b9c0f-067b-48f0-b2a8-d63ecc7ec2d7 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:55.563138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea51a74-b56f-4c2f-920e-fc406455537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:55.564686 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea51a74-b56f-4c2f-920e-fc406455537d None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:55.565653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea51a74-b56f-4c2f-920e-fc406455537d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:55.566457 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea51a74-b56f-4c2f-920e-fc406455537d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:55.581514 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea51a74-b56f-4c2f-920e-fc406455537d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:55.585172 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea51a74-b56f-4c2f-920e-fc406455537d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-dea51a74-b56f-4c2f-920e-fc406455537d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:55.611249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:55.612982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:55.615604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:55.615604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:55.615604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:55.615604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:55.615604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:55.615604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:55.615604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:55.615604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:55.615604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 426/857] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:55.622857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea51a74-b56f-4c2f-920e-fc406455537d None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:55.672266 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:55.753992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b9c0f-067b-48f0-b2a8-d63ecc7ec2d7 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:55.780954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:55.799073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea51a74-b56f-4c2f-920e-fc406455537d None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:55.808678 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342be77-aa11-49b9-876d-8d058fa0c027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:55.809977 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342be77-aa11-49b9-876d-8d058fa0c027 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:55.811362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342be77-aa11-49b9-876d-8d058fa0c027 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:55.811362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342be77-aa11-49b9-876d-8d058fa0c027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:55.840196 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a3551-089a-4af5-93b6-dbba0f81c157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:55.841277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a3551-089a-4af5-93b6-dbba0f81c157 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:55.841628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a3551-089a-4af5-93b6-dbba0f81c157 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:55.842311 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a3551-089a-4af5-93b6-dbba0f81c157 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:55.843620 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a3551-089a-4af5-93b6-dbba0f81c157 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:55.844196 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a3551-089a-4af5-93b6-dbba0f81c157 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:55.846120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a3551-089a-4af5-93b6-dbba0f81c157 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:55.862053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 427/858] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:55.862257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b952eec-02d5-4521-8367-4b27449ebcd2 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:55.862474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b952eec-02d5-4521-8367-4b27449ebcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:55.862757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b952eec-02d5-4521-8367-4b27449ebcd2 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:55.864260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 428/859] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:55.867013 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b952eec-02d5-4521-8367-4b27449ebcd2 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:55.896866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342be77-aa11-49b9-876d-8d058fa0c027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:55.898564 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342be77-aa11-49b9-876d-8d058fa0c027 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:55.974440 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:55.991003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b952eec-02d5-4521-8367-4b27449ebcd2 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:56.030660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 432/860] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:10:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:10:56.032649 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ecd52-ed3f-47d7-a1e2-98b89f4bbe43 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:56.032944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ecd52-ed3f-47d7-a1e2-98b89f4bbe43 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:56.033363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ecd52-ed3f-47d7-a1e2-98b89f4bbe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:56.037520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266136a-480e-4764-9e8d-9efcbbd40d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:56.038273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266136a-480e-4764-9e8d-9efcbbd40d2e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:56.038613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266136a-480e-4764-9e8d-9efcbbd40d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:56.038953 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266136a-480e-4764-9e8d-9efcbbd40d2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:56.040993 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266136a-480e-4764-9e8d-9efcbbd40d2e None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=ad48c627d5d142489f40584eea36a17f) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:56.040993 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266136a-480e-4764-9e8d-9efcbbd40d2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:56.042022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266136a-480e-4764-9e8d-9efcbbd40d2e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:56.062064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 429/861] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:55 2022] GET /identity/v3/role_assignments?user.id=ad48c627d5d142489f40584eea36a17f&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:56.062064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266136a-480e-4764-9e8d-9efcbbd40d2e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:56.063871 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-3b5ecd52-ed3f-47d7-a1e2-98b89f4bbe43 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:56.065205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3b5ecd52-ed3f-47d7-a1e2-98b89f4bbe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:56.083462 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:56.175203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 433/862] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:56.199322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ecd52-ed3f-47d7-a1e2-98b89f4bbe43 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:56.210806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266136a-480e-4764-9e8d-9efcbbd40d2e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:56.252007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ac000-2c39-44e5-91c9-91a031d4e699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:56.253023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac000-2c39-44e5-91c9-91a031d4e699 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:56.253605 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac000-2c39-44e5-91c9-91a031d4e699 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:56.253889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ac000-2c39-44e5-91c9-91a031d4e699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:56.269771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ac000-2c39-44e5-91c9-91a031d4e699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:56.271384 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ac000-2c39-44e5-91c9-91a031d4e699 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-c06ac000-2c39-44e5-91c9-91a031d4e699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:56.292866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:56.294533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:56.297489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:56.297489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:56.297489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:56.297489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:56.299534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 430/863] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:56.302423 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ac000-2c39-44e5-91c9-91a031d4e699 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:56.330733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:56.347299 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ecd52-ed3f-47d7-a1e2-98b89f4bbe43 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:56.399746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba58790-583a-471d-9335-1e8b89995253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:56.400558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba58790-583a-471d-9335-1e8b89995253 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:56.400933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba58790-583a-471d-9335-1e8b89995253 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:56.401220 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba58790-583a-471d-9335-1e8b89995253 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:56.401865 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba58790-583a-471d-9335-1e8b89995253 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:56.403289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba58790-583a-471d-9335-1e8b89995253 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:56.406728 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-5ba58790-583a-471d-9335-1e8b89995253 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:56.416291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:56.417296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:10:56.418416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:56.422130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 434/864] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Aug 2 08:10:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:56.424118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba58790-583a-471d-9335-1e8b89995253 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:56.465034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ac000-2c39-44e5-91c9-91a031d4e699 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:56.523677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d8809-a7e4-4b33-bd84-3f8a331d7942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:56.524789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d8809-a7e4-4b33-bd84-3f8a331d7942 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:56.525345 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d8809-a7e4-4b33-bd84-3f8a331d7942 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:56.525917 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d8809-a7e4-4b33-bd84-3f8a331d7942 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:56.527338 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d8809-a7e4-4b33-bd84-3f8a331d7942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:56.528084 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d8809-a7e4-4b33-bd84-3f8a331d7942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:56.531712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d8809-a7e4-4b33-bd84-3f8a331d7942 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:56.551669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 431/865] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:56.561443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d8809-a7e4-4b33-bd84-3f8a331d7942 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:56.583537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba58790-583a-471d-9335-1e8b89995253 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:56.641459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce5a88-aec9-42e5-8909-d0db9b7c2fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:56.642618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce5a88-aec9-42e5-8909-d0db9b7c2fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:56.643007 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce5a88-aec9-42e5-8909-d0db9b7c2fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:56.643390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce5a88-aec9-42e5-8909-d0db9b7c2fe9 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:56.644196 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce5a88-aec9-42e5-8909-d0db9b7c2fe9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:56.644630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce5a88-aec9-42e5-8909-d0db9b7c2fe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:56.646172 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce5a88-aec9-42e5-8909-d0db9b7c2fe9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:56.653055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 435/866] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 08:10:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:10:56.663261 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce5a88-aec9-42e5-8909-d0db9b7c2fe9 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:56.691366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:56.710107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d8809-a7e4-4b33-bd84-3f8a331d7942 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:56.753395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:56.767955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028aa0c-cb62-49f3-824e-05dc445d33c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:56.768764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028aa0c-cb62-49f3-824e-05dc445d33c0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:56.769167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028aa0c-cb62-49f3-824e-05dc445d33c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:56.769543 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028aa0c-cb62-49f3-824e-05dc445d33c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:56.778915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028aa0c-cb62-49f3-824e-05dc445d33c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:56.781123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028aa0c-cb62-49f3-824e-05dc445d33c0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-3028aa0c-cb62-49f3-824e-05dc445d33c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:10:56.798708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:56.800257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:56.801628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:10:56.801628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:10:56.801628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:10:56.801628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:10:56.801628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:10:56.801628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:10:56.801628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:10:56.801628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:56.803502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 432/867] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:10:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:10:56.814730 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028aa0c-cb62-49f3-824e-05dc445d33c0 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:56.823738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce5a88-aec9-42e5-8909-d0db9b7c2fe9 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:56.896591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a665f-c501-4aaa-8875-1be834c290a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:56.898957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a665f-c501-4aaa-8875-1be834c290a1 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:56.899606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a665f-c501-4aaa-8875-1be834c290a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:56.900513 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a665f-c501-4aaa-8875-1be834c290a1 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:56.902522 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a665f-c501-4aaa-8875-1be834c290a1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:56.903251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a665f-c501-4aaa-8875-1be834c290a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:56.906801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a665f-c501-4aaa-8875-1be834c290a1 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:56.922101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 436/868] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 08:10:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:56.996549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028aa0c-cb62-49f3-824e-05dc445d33c0 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:57.043459 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fbb71-d05c-425b-874d-e0fb63a5eaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:57.044514 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fbb71-d05c-425b-874d-e0fb63a5eaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:57.045054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fbb71-d05c-425b-874d-e0fb63a5eaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:57.045492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fbb71-d05c-425b-874d-e0fb63a5eaf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:57.046512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fbb71-d05c-425b-874d-e0fb63a5eaf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:57.047054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fbb71-d05c-425b-874d-e0fb63a5eaf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:57.048753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fbb71-d05c-425b-874d-e0fb63a5eaf7 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:57.065708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 433/869] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:57.072898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a665f-c501-4aaa-8875-1be834c290a1 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:57.196781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:57.221626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a665f-c501-4aaa-8875-1be834c290a1 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:57.261873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753883f-51ed-45bf-b59f-3b447dd5741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:57.262549 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753883f-51ed-45bf-b59f-3b447dd5741a None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:57.262828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753883f-51ed-45bf-b59f-3b447dd5741a None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:57.263101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753883f-51ed-45bf-b59f-3b447dd5741a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:57.264444 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753883f-51ed-45bf-b59f-3b447dd5741a None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=e02b653d2f5e4faca2906b2fbd1bfc5c) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:57.264827 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753883f-51ed-45bf-b59f-3b447dd5741a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:57.266296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753883f-51ed-45bf-b59f-3b447dd5741a None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:57.274375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 437/870] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:10:57 2022] GET /identity/v3/role_assignments?user.id=e02b653d2f5e4faca2906b2fbd1bfc5c&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:57.638379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06e683-5bd1-4eef-99b2-a41028409810 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:57.639432 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06e683-5bd1-4eef-99b2-a41028409810 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:57.639875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06e683-5bd1-4eef-99b2-a41028409810 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:57.641915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 434/871] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:57.648494 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ff7b-4748-4196-85f8-fee22cf066f0 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:57.649100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ff7b-4748-4196-85f8-fee22cf066f0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:57.649666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ff7b-4748-4196-85f8-fee22cf066f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:57.671703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-4f32ff7b-4748-4196-85f8-fee22cf066f0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:57.672925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4f32ff7b-4748-4196-85f8-fee22cf066f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:57.782169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 438/872] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:57.806130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06e683-5bd1-4eef-99b2-a41028409810 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:57.875466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:57.960105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d06e683-5bd1-4eef-99b2-a41028409810 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:58.000197 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9e6eb-38b0-4701-b01c-7c4d0543109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:58.001711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e6eb-38b0-4701-b01c-7c4d0543109f None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:58.002241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e6eb-38b0-4701-b01c-7c4d0543109f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:58.002720 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9e6eb-38b0-4701-b01c-7c4d0543109f None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:58.003644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9e6eb-38b0-4701-b01c-7c4d0543109f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:58.005238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9e6eb-38b0-4701-b01c-7c4d0543109f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:58.031189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 435/873] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:10:57 2022] POST /identity/v3/services => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:10:58.655350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f127f3-1c39-477a-86a3-2217e771e053 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:58.656135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f127f3-1c39-477a-86a3-2217e771e053 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:58.656135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f127f3-1c39-477a-86a3-2217e771e053 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:58.657443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 439/874] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:10:58.663109 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6bfbe-5041-43f9-8bd2-aed2e3ad8cf6 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:58.663377 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6bfbe-5041-43f9-8bd2-aed2e3ad8cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:58.663684 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6bfbe-5041-43f9-8bd2-aed2e3ad8cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:58.687312 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-7bd6bfbe-5041-43f9-8bd2-aed2e3ad8cf6 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:58.688702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7bd6bfbe-5041-43f9-8bd2-aed2e3ad8cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:58.785482 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 436/875] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:58 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:10:58.820602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f127f3-1c39-477a-86a3-2217e771e053 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:58.924503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:58.956391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f127f3-1c39-477a-86a3-2217e771e053 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:59.003789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c2601-3f9b-4c54-aef8-370a3597853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:59.004490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c2601-3f9b-4c54-aef8-370a3597853f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:59.004778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c2601-3f9b-4c54-aef8-370a3597853f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:59.005049 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c2601-3f9b-4c54-aef8-370a3597853f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:59.019066 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c2601-3f9b-4c54-aef8-370a3597853f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-0e5c2601-3f9b-4c54-aef8-370a3597853f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:10:59.024540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:59.026284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:59.028022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 440/876] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 08:10:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:59.035709 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6bfbe-5041-43f9-8bd2-aed2e3ad8cf6 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:59.077090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:59.162218 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6bfbe-5041-43f9-8bd2-aed2e3ad8cf6 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:59.206431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4dc2-e6d5-476e-8334-39b046817746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:59.207796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4dc2-e6d5-476e-8334-39b046817746 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:59.208476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4dc2-e6d5-476e-8334-39b046817746 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:59.209152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4dc2-e6d5-476e-8334-39b046817746 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:59.210534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f4dc2-e6d5-476e-8334-39b046817746 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:59.211265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f4dc2-e6d5-476e-8334-39b046817746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:59.213751 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f4dc2-e6d5-476e-8334-39b046817746 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:59.228169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 437/877] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 08:10:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:59.234151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c2601-3f9b-4c54-aef8-370a3597853f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:59.349963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c2601-3f9b-4c54-aef8-370a3597853f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:59.394532 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc2e3c-8547-4c1e-95dc-37187e08fa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:59.395211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc2e3c-8547-4c1e-95dc-37187e08fa10 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:59.395500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc2e3c-8547-4c1e-95dc-37187e08fa10 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:59.395783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc2e3c-8547-4c1e-95dc-37187e08fa10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:59.399112 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:59.408844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc2e3c-8547-4c1e-95dc-37187e08fa10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:59.410352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc2e3c-8547-4c1e-95dc-37187e08fa10 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-dffc2e3c-8547-4c1e-95dc-37187e08fa10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:10:59.427121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:59.428170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:59.429303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:10:59.429303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:10:59.429303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:10:59.429303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:10:59.429303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 441/878] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:59.435207 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4dc2-e6d5-476e-8334-39b046817746 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:59.528348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95373f-567a-4234-ad91-053c00ddc321 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:59.528590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95373f-567a-4234-ad91-053c00ddc321 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:59.528783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95373f-567a-4234-ad91-053c00ddc321 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:59.530994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 442/879] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:10:59.536081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfbe18-7381-49c3-9e1e-59f6635967ca None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:59.536409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfbe18-7381-49c3-9e1e-59f6635967ca None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:59.536813 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfbe18-7381-49c3-9e1e-59f6635967ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:59.546387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:59.551988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4dc2-e6d5-476e-8334-39b046817746 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:59.566878 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-1ddfbe18-7381-49c3-9e1e-59f6635967ca None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:59.568730 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1ddfbe18-7381-49c3-9e1e-59f6635967ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:59.590211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd646d2-b4af-42cb-bd65-33e53b57778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:59.591186 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd646d2-b4af-42cb-bd65-33e53b57778c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:59.591663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd646d2-b4af-42cb-bd65-33e53b57778c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:59.592657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd646d2-b4af-42cb-bd65-33e53b57778c None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:59.593562 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd646d2-b4af-42cb-bd65-33e53b57778c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:10:59.594085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd646d2-b4af-42cb-bd65-33e53b57778c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:59.596775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd646d2-b4af-42cb-bd65-33e53b57778c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:59.610736 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 438/880] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:10:59.618422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd646d2-b4af-42cb-bd65-33e53b57778c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:59.691146 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 443/881] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:10:59.693162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ca9d-ec52-4c04-b92f-7d8411f2740d None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:59.693432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ca9d-ec52-4c04-b92f-7d8411f2740d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:59.693781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ca9d-ec52-4c04-b92f-7d8411f2740d None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:59.695325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 444/882] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:10:59.700463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133ccc7-0ff8-41ef-91a1-0c5e6fbab433 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:59.700814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133ccc7-0ff8-41ef-91a1-0c5e6fbab433 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:59.701165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133ccc7-0ff8-41ef-91a1-0c5e6fbab433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:59.722692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-5133ccc7-0ff8-41ef-91a1-0c5e6fbab433 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:10:59.723956 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5133ccc7-0ff8-41ef-91a1-0c5e6fbab433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:10:59.761208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd646d2-b4af-42cb-bd65-33e53b57778c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:59.801012 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b697e5-71d1-4007-8708-8e08d3733d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:10:59.801583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b697e5-71d1-4007-8708-8e08d3733d86 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:10:59.801856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b697e5-71d1-4007-8708-8e08d3733d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:10:59.802205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b697e5-71d1-4007-8708-8e08d3733d86 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:10:59.812320 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b697e5-71d1-4007-8708-8e08d3733d86 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:10:59.813963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b697e5-71d1-4007-8708-8e08d3733d86 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:10:59.821448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 445/883] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:10:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-60b697e5-71d1-4007-8708-8e08d3733d86 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:10:59.825791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:10:59.827510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:10:59.828506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:10:59.828506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:10:59.828506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:10:59.828506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:10:59.828506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:10:59.828506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:10:59.828506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:10:59.828506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:10:59.828506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:10:59.828506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:10:59.830517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133ccc7-0ff8-41ef-91a1-0c5e6fbab433 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:59.832314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 439/884] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 08:10:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:10:59.833242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b697e5-71d1-4007-8708-8e08d3733d86 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:10:59.852431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:59.908880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:10:59.958944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b697e5-71d1-4007-8708-8e08d3733d86 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:10:59.996327 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133ccc7-0ff8-41ef-91a1-0c5e6fbab433 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:00.002820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e923d59-d2bb-4945-acb1-93a9b8d5e065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:00.003613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e923d59-d2bb-4945-acb1-93a9b8d5e065 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:00.004021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e923d59-d2bb-4945-acb1-93a9b8d5e065 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:00.004417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e923d59-d2bb-4945-acb1-93a9b8d5e065 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:00.005758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e923d59-d2bb-4945-acb1-93a9b8d5e065 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:00.006244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e923d59-d2bb-4945-acb1-93a9b8d5e065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:00.008174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e923d59-d2bb-4945-acb1-93a9b8d5e065 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:00.030879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 440/885] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 08:10:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:00.036110 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e923d59-d2bb-4945-acb1-93a9b8d5e065 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:00.041607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3bafb-7599-432b-a566-9c3540f65675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:00.042801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3bafb-7599-432b-a566-9c3540f65675 None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:00.042992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3bafb-7599-432b-a566-9c3540f65675 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:00.043246 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3bafb-7599-432b-a566-9c3540f65675 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:00.043956 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3bafb-7599-432b-a566-9c3540f65675 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:00.045971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3bafb-7599-432b-a566-9c3540f65675 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:00.074913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 446/886] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:10:59 2022] POST /identity/v3/services => generated 269 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:11:00.075594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3bafb-7599-432b-a566-9c3540f65675 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:00.148064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:00.192054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e923d59-d2bb-4945-acb1-93a9b8d5e065 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:00.233533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3bafb-7599-432b-a566-9c3540f65675 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:00.235262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe051a-cc99-4fd9-ad3b-6377954f98df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:00.236047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe051a-cc99-4fd9-ad3b-6377954f98df None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:00.236340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe051a-cc99-4fd9-ad3b-6377954f98df None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:00.236693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe051a-cc99-4fd9-ad3b-6377954f98df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:00.237347 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe051a-cc99-4fd9-ad3b-6377954f98df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:00.237861 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:00.240352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe051a-cc99-4fd9-ad3b-6377954f98df None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-aafe051a-cc99-4fd9-ad3b-6377954f98df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:00.252978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:00.254134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:00.254989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 441/887] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 08:11:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:00.263342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe051a-cc99-4fd9-ad3b-6377954f98df None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:00.289314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98c476-fd6d-4988-a435-6ecf95197c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:00.290986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98c476-fd6d-4988-a435-6ecf95197c6f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:00.290986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98c476-fd6d-4988-a435-6ecf95197c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:00.291213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98c476-fd6d-4988-a435-6ecf95197c6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:00.385155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98c476-fd6d-4988-a435-6ecf95197c6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:00.386657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98c476-fd6d-4988-a435-6ecf95197c6f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:00.417239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe051a-cc99-4fd9-ad3b-6377954f98df None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:00.469242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da358627-912e-42c5-8042-487d0fd54386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:00.469876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da358627-912e-42c5-8042-487d0fd54386 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:00.470188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da358627-912e-42c5-8042-487d0fd54386 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:00.470467 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da358627-912e-42c5-8042-487d0fd54386 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:00.471157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da358627-912e-42c5-8042-487d0fd54386 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:00.471463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da358627-912e-42c5-8042-487d0fd54386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:00.472822 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da358627-912e-42c5-8042-487d0fd54386 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:00.474985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:00.482333 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 442/888] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 08:11:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:00.484023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc14e0c-56e6-4aef-ae26-c227c20ba503 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:00.484322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc14e0c-56e6-4aef-ae26-c227c20ba503 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:00.484604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc14e0c-56e6-4aef-ae26-c227c20ba503 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:00.486057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 443/889] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:00.490948 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc14e0c-56e6-4aef-ae26-c227c20ba503 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:00.524096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 447/890] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:11:00 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:11:00.524096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deaf99-9a89-4c16-8232-3376c7955fdf None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:00.524096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deaf99-9a89-4c16-8232-3376c7955fdf None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:00.524096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deaf99-9a89-4c16-8232-3376c7955fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:00.529496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:00.547967 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-89deaf99-9a89-4c16-8232-3376c7955fdf None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:00.549335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-89deaf99-9a89-4c16-8232-3376c7955fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:00.640356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 448/891] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:00.641271 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deaf99-9a89-4c16-8232-3376c7955fdf None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:00.651109 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc14e0c-56e6-4aef-ae26-c227c20ba503 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:00.691835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98f335-ce5b-436e-a652-ee5b0cd43104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:00.692470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98f335-ce5b-436e-a652-ee5b0cd43104 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:00.692747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98f335-ce5b-436e-a652-ee5b0cd43104 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:00.693022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98f335-ce5b-436e-a652-ee5b0cd43104 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:00.693710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98f335-ce5b-436e-a652-ee5b0cd43104 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:00.694034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98f335-ce5b-436e-a652-ee5b0cd43104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:00.695440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98f335-ce5b-436e-a652-ee5b0cd43104 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:00.701175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 444/892] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 08:11:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:00.702124 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98f335-ce5b-436e-a652-ee5b0cd43104 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:00.808053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deaf99-9a89-4c16-8232-3376c7955fdf None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:00.812618 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:00.870520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e062-0b17-4594-8a19-ef83180a68e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:00.872132 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e062-0b17-4594-8a19-ef83180a68e6 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:00.872894 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e062-0b17-4594-8a19-ef83180a68e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:00.874047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e062-0b17-4594-8a19-ef83180a68e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:00.875342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98f335-ce5b-436e-a652-ee5b0cd43104 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:00.876867 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:00.892502 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e062-0b17-4594-8a19-ef83180a68e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:00.895012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e062-0b17-4594-8a19-ef83180a68e6 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-6678e062-0b17-4594-8a19-ef83180a68e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:00.915014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:00.916431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:00.917352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:00.917352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:00.917352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:00.917352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:00.917352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 449/893] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:00.924683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e062-0b17-4594-8a19-ef83180a68e6 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:00.935622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecefe6a-00c9-49c7-9bf6-4b6e3b57501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:00.936292 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecefe6a-00c9-49c7-9bf6-4b6e3b57501e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:00.936571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecefe6a-00c9-49c7-9bf6-4b6e3b57501e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:00.937085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecefe6a-00c9-49c7-9bf6-4b6e3b57501e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:00.937667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecefe6a-00c9-49c7-9bf6-4b6e3b57501e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:00.940370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecefe6a-00c9-49c7-9bf6-4b6e3b57501e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-4ecefe6a-00c9-49c7-9bf6-4b6e3b57501e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:00.951039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:00.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:11:00.955024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:00.962693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 445/894] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:11:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:00.962693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecefe6a-00c9-49c7-9bf6-4b6e3b57501e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:01.068028 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e062-0b17-4594-8a19-ef83180a68e6 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:01.096967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecefe6a-00c9-49c7-9bf6-4b6e3b57501e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:01.105851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b0410-f25b-4224-af28-5db1e1ffab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:01.106517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b0410-f25b-4224-af28-5db1e1ffab8d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:01.106803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b0410-f25b-4224-af28-5db1e1ffab8d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:01.107108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b0410-f25b-4224-af28-5db1e1ffab8d None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:01.107904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b0410-f25b-4224-af28-5db1e1ffab8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:01.108233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b0410-f25b-4224-af28-5db1e1ffab8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:01.109635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b0410-f25b-4224-af28-5db1e1ffab8d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:01.125165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 450/895] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:01.130994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b0410-f25b-4224-af28-5db1e1ffab8d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:01.136162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:01.148452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c76fb-24f8-400e-b3e5-2ee79aadd01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:01.148832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c76fb-24f8-400e-b3e5-2ee79aadd01c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:01.149114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c76fb-24f8-400e-b3e5-2ee79aadd01c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:01.149389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c76fb-24f8-400e-b3e5-2ee79aadd01c None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:01.150183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c76fb-24f8-400e-b3e5-2ee79aadd01c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:01.150493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c76fb-24f8-400e-b3e5-2ee79aadd01c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:01.152015 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c76fb-24f8-400e-b3e5-2ee79aadd01c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:01.157956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 446/896] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:11:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:01.163119 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c76fb-24f8-400e-b3e5-2ee79aadd01c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:01.196338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:01.259078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b0410-f25b-4224-af28-5db1e1ffab8d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:01.299934 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0691b3-0a29-4391-b394-73a62a300410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:01.301087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0691b3-0a29-4391-b394-73a62a300410 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:01.301575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0691b3-0a29-4391-b394-73a62a300410 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:01.302130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0691b3-0a29-4391-b394-73a62a300410 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:01.304976 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c76fb-24f8-400e-b3e5-2ee79aadd01c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:01.310461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0691b3-0a29-4391-b394-73a62a300410 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:01.312264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0691b3-0a29-4391-b394-73a62a300410 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-1b0691b3-0a29-4391-b394-73a62a300410 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:11:01.325517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:01.327103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:01.328004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:11:01.328004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:11:01.328004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:11:01.328004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:11:01.328004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:11:01.328004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:11:01.328004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:01.328004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:01.330887 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 451/897] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:11:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:01.337303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0691b3-0a29-4391-b394-73a62a300410 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:01.363271 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9314e-621b-40a7-ab5d-23bdb02a98a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:01.364331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9314e-621b-40a7-ab5d-23bdb02a98a8 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:01.364928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9314e-621b-40a7-ab5d-23bdb02a98a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:01.365433 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9314e-621b-40a7-ab5d-23bdb02a98a8 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:01.366440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9314e-621b-40a7-ab5d-23bdb02a98a8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:01.366999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9314e-621b-40a7-ab5d-23bdb02a98a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:01.368887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9314e-621b-40a7-ab5d-23bdb02a98a8 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:01.376073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 447/898] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:11:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:01.382673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9314e-621b-40a7-ab5d-23bdb02a98a8 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:01.454915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:01.466528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0691b3-0a29-4391-b394-73a62a300410 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:01.475581 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:01.507603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f86eb-5eba-4fc6-820d-d050fe408b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:01.508624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f86eb-5eba-4fc6-820d-d050fe408b66 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:01.509129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f86eb-5eba-4fc6-820d-d050fe408b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:01.509688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f86eb-5eba-4fc6-820d-d050fe408b66 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:01.510724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f86eb-5eba-4fc6-820d-d050fe408b66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:01.511267 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f86eb-5eba-4fc6-820d-d050fe408b66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:01.513238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9314e-621b-40a7-ab5d-23bdb02a98a8 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:01.514724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f86eb-5eba-4fc6-820d-d050fe408b66 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:01.536552 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 452/899] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:11:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:01.537979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f86eb-5eba-4fc6-820d-d050fe408b66 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:01.554105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52824d-9e27-453c-a6c8-7bdc3af9a9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:01.554788 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52824d-9e27-453c-a6c8-7bdc3af9a9fd None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:01.555067 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52824d-9e27-453c-a6c8-7bdc3af9a9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:01.555340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52824d-9e27-453c-a6c8-7bdc3af9a9fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:01.556159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52824d-9e27-453c-a6c8-7bdc3af9a9fd None admin] RBAC: Adding query filter params (interface=public, service_id=5d2c761c20cf46a98ae1cdd2539c05e8, region_id=RegionOne) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:01.556469 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52824d-9e27-453c-a6c8-7bdc3af9a9fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:01.557972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52824d-9e27-453c-a6c8-7bdc3af9a9fd None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:01.564219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 448/900] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 08:11:01 2022] GET /identity/v3/endpoints?service_id=5d2c761c20cf46a98ae1cdd2539c05e8&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:01.569603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52824d-9e27-453c-a6c8-7bdc3af9a9fd None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:01.655358 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f86eb-5eba-4fc6-820d-d050fe408b66 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:01.688648 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52824d-9e27-453c-a6c8-7bdc3af9a9fd None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:01.695439 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ab924-348a-47a7-b636-287ad9c98b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:01.696403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ab924-348a-47a7-b636-287ad9c98b2f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:01.696923 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ab924-348a-47a7-b636-287ad9c98b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:01.697405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ab924-348a-47a7-b636-287ad9c98b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:01.698441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ab924-348a-47a7-b636-287ad9c98b2f None admin] RBAC: Adding query filter params (role.id=ffef296fbbfa4bdb94ad2fc75f4e92f2, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=ad48c627d5d142489f40584eea36a17f) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:01.698967 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ab924-348a-47a7-b636-287ad9c98b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:01.700617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ab924-348a-47a7-b636-287ad9c98b2f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:01.714457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 453/901] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:11:01 2022] GET /identity/v3/role_assignments?user.id=ad48c627d5d142489f40584eea36a17f&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=ffef296fbbfa4bdb94ad2fc75f4e92f2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:01.714650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:01.733557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0677b-6e83-490b-8159-5ff9413f074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:01.734233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0677b-6e83-490b-8159-5ff9413f074f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:01.734513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0677b-6e83-490b-8159-5ff9413f074f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:01.734787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0677b-6e83-490b-8159-5ff9413f074f None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:01.735464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0677b-6e83-490b-8159-5ff9413f074f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:01.736882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0677b-6e83-490b-8159-5ff9413f074f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:01.744298 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 449/902] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 08:11:01 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:11:02.488101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7748c7-71d0-42c4-a32f-ce2ee559acc5 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:02.489586 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7748c7-71d0-42c4-a32f-ce2ee559acc5 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:02.490352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7748c7-71d0-42c4-a32f-ce2ee559acc5 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:02.492980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 454/903] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:02.499446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817c0a-911f-438b-a633-810e81739fd5 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:02.500239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817c0a-911f-438b-a633-810e81739fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:02.500239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf817c0a-911f-438b-a633-810e81739fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:02.523666 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-cf817c0a-911f-438b-a633-810e81739fd5 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:02.525202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-cf817c0a-911f-438b-a633-810e81739fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:02.622446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 450/904] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:11:02.654431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7748c7-71d0-42c4-a32f-ce2ee559acc5 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:02.697752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:02.811352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7748c7-71d0-42c4-a32f-ce2ee559acc5 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:02.862306 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f5ca4-f634-4223-ba21-6162ae98d76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:02.863408 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f5ca4-f634-4223-ba21-6162ae98d76f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:02.863848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f5ca4-f634-4223-ba21-6162ae98d76f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:02.864447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f5ca4-f634-4223-ba21-6162ae98d76f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:02.865326 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f5ca4-f634-4223-ba21-6162ae98d76f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:02.867173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f5ca4-f634-4223-ba21-6162ae98d76f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-8a6f5ca4-f634-4223-ba21-6162ae98d76f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:02.878292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:02.879553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:11:02.880548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:02.888170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 455/905] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Aug 2 08:11:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:02.890072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf817c0a-911f-438b-a633-810e81739fd5 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:03.015388 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf817c0a-911f-438b-a633-810e81739fd5 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:03.034568 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:03.054511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456e413-5d37-42c9-9cbc-73fe25822dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:03.055142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e413-5d37-42c9-9cbc-73fe25822dfe None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:03.055433 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e413-5d37-42c9-9cbc-73fe25822dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:03.055679 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456e413-5d37-42c9-9cbc-73fe25822dfe None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:03.056356 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456e413-5d37-42c9-9cbc-73fe25822dfe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:03.056657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456e413-5d37-42c9-9cbc-73fe25822dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:03.058059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456e413-5d37-42c9-9cbc-73fe25822dfe None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:03.064313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 451/906] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 08:11:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:03.073943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f5ca4-f634-4223-ba21-6162ae98d76f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:03.100517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2b52-43b5-44a4-8b22-12a4d8b3d3d2 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:03.100848 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2b52-43b5-44a4-8b22-12a4d8b3d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:03.101080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2b52-43b5-44a4-8b22-12a4d8b3d3d2 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:03.103841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 452/907] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:03.110675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e201a8f-0bc4-4629-8c10-622e96456ef8 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:03.110957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e201a8f-0bc4-4629-8c10-622e96456ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:03.111237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e201a8f-0bc4-4629-8c10-622e96456ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:03.135177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3e201a8f-0bc4-4629-8c10-622e96456ef8 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:03.136958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3e201a8f-0bc4-4629-8c10-622e96456ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:03.238038 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:03.245461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f5ca4-f634-4223-ba21-6162ae98d76f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:03.246812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 453/908] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:03.269532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e201a8f-0bc4-4629-8c10-622e96456ef8 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:03.300409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fb130-43f2-4c21-9fac-46264b7a4f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:03.301414 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fb130-43f2-4c21-9fac-46264b7a4f16 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:03.301920 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fb130-43f2-4c21-9fac-46264b7a4f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:03.302444 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fb130-43f2-4c21-9fac-46264b7a4f16 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:03.304032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fb130-43f2-4c21-9fac-46264b7a4f16 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:03.304843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fb130-43f2-4c21-9fac-46264b7a4f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:03.307247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fb130-43f2-4c21-9fac-46264b7a4f16 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:03.315489 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 456/909] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 08:11:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:03.322412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fb130-43f2-4c21-9fac-46264b7a4f16 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:03.430219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e201a8f-0bc4-4629-8c10-622e96456ef8 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:03.444720 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:03.448803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fb130-43f2-4c21-9fac-46264b7a4f16 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:03.487005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0bdb1-97e8-4dbf-a583-8b5d6072d221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:03.487680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0bdb1-97e8-4dbf-a583-8b5d6072d221 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:03.487962 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0bdb1-97e8-4dbf-a583-8b5d6072d221 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:03.488183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3ac1d-06c7-496c-bdba-c4e3d1d8730c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:03.488301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0bdb1-97e8-4dbf-a583-8b5d6072d221 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:03.488974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0bdb1-97e8-4dbf-a583-8b5d6072d221 None admin] RBAC: Adding query filter params (interface=public, service_id=ad8643da699d4522aead058cef4382af, region_id=RegionOne) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:03.489280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0bdb1-97e8-4dbf-a583-8b5d6072d221 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:03.489895 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ac1d-06c7-496c-bdba-c4e3d1d8730c None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:03.490396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ac1d-06c7-496c-bdba-c4e3d1d8730c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:03.490671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0bdb1-97e8-4dbf-a583-8b5d6072d221 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:03.490990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3ac1d-06c7-496c-bdba-c4e3d1d8730c None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:03.491791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3ac1d-06c7-496c-bdba-c4e3d1d8730c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:03.493595 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3ac1d-06c7-496c-bdba-c4e3d1d8730c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:03.500181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 457/910] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 08:11:03 2022] GET /identity/v3/endpoints?service_id=ad8643da699d4522aead058cef4382af&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:03.506496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0bdb1-97e8-4dbf-a583-8b5d6072d221 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:03.515802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 454/911] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:11:03 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:11:03.539879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:03.635729 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0bdb1-97e8-4dbf-a583-8b5d6072d221 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:03.683568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00c0f0-05df-454d-8ec5-304d0797cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:03.684207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00c0f0-05df-454d-8ec5-304d0797cb01 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:03.684490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00c0f0-05df-454d-8ec5-304d0797cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:03.684764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00c0f0-05df-454d-8ec5-304d0797cb01 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:03.686043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00c0f0-05df-454d-8ec5-304d0797cb01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:03.687416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00c0f0-05df-454d-8ec5-304d0797cb01 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:03.694188 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 458/912] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 08:11:03 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:11:04.169037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08b4be-2158-4ae6-a3b7-8f2c57c0c866 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:04.169226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08b4be-2158-4ae6-a3b7-8f2c57c0c866 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:04.169505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08b4be-2158-4ae6-a3b7-8f2c57c0c866 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:04.171829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 455/913] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:04.178244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c162f70-d4ed-4809-a06c-532e2d787bb9 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:04.178642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c162f70-d4ed-4809-a06c-532e2d787bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:04.178942 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c162f70-d4ed-4809-a06c-532e2d787bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:04.201741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-1c162f70-d4ed-4809-a06c-532e2d787bb9 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:04.203175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1c162f70-d4ed-4809-a06c-532e2d787bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:04.225125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c988e-9e9e-4243-bb51-ea35f02ecfe6 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:04.225455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c988e-9e9e-4243-bb51-ea35f02ecfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:04.225712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c988e-9e9e-4243-bb51-ea35f02ecfe6 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:04.227571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 456/914] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:11:04.233532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e76da-5a18-4fdb-80b9-911f9f6b3d57 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:04.233892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e76da-5a18-4fdb-80b9-911f9f6b3d57 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:04.234226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e76da-5a18-4fdb-80b9-911f9f6b3d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:04.255871 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-299e76da-5a18-4fdb-80b9-911f9f6b3d57 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:04.257222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-299e76da-5a18-4fdb-80b9-911f9f6b3d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:04.302039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 459/915] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:04.329204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c162f70-d4ed-4809-a06c-532e2d787bb9 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:04.374035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 457/916] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:11:04.374221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:04.399397 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e76da-5a18-4fdb-80b9-911f9f6b3d57 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:04.483085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c162f70-d4ed-4809-a06c-532e2d787bb9 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:04.526502 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979de2d-bda3-48c6-8ca3-135b27a4e080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:04.527183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979de2d-bda3-48c6-8ca3-135b27a4e080 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:04.527415 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979de2d-bda3-48c6-8ca3-135b27a4e080 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:04.527914 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979de2d-bda3-48c6-8ca3-135b27a4e080 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:04.536344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:04.540401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e76da-5a18-4fdb-80b9-911f9f6b3d57 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:04.543633 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979de2d-bda3-48c6-8ca3-135b27a4e080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-5979de2d-bda3-48c6-8ca3-135b27a4e080 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:11:04.552194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:04.553390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:11:04.554354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:04.562042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 460/917] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 08:11:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:04.564045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979de2d-bda3-48c6-8ca3-135b27a4e080 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:04.595158 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed8305-2487-4241-8877-de3eae977330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:04.595831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed8305-2487-4241-8877-de3eae977330 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:04.596114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed8305-2487-4241-8877-de3eae977330 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:04.596390 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed8305-2487-4241-8877-de3eae977330 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:04.597359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed8305-2487-4241-8877-de3eae977330 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:04.598793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed8305-2487-4241-8877-de3eae977330 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-c1ed8305-2487-4241-8877-de3eae977330 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:04.608833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:04.610131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 08:11:04.611088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:04.614374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 458/918] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:11:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:04.616821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed8305-2487-4241-8877-de3eae977330 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:04.678579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:04.693163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979de2d-bda3-48c6-8ca3-135b27a4e080 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:04.735020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0fccc-86eb-4107-ab2c-9264df590fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:04.735655 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0fccc-86eb-4107-ab2c-9264df590fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:04.736090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0fccc-86eb-4107-ab2c-9264df590fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:04.736619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0fccc-86eb-4107-ab2c-9264df590fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:04.737929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0fccc-86eb-4107-ab2c-9264df590fc3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:04.738295 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0fccc-86eb-4107-ab2c-9264df590fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:04.739950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0fccc-86eb-4107-ab2c-9264df590fc3 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:04.753040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 461/919] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 08:11:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:04.758581 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0fccc-86eb-4107-ab2c-9264df590fc3 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:04.762486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed8305-2487-4241-8877-de3eae977330 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:04.814795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6475224-2369-4c37-a60f-39bad20b04cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:04.815721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6475224-2369-4c37-a60f-39bad20b04cb None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:04.816144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6475224-2369-4c37-a60f-39bad20b04cb None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:04.816566 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6475224-2369-4c37-a60f-39bad20b04cb None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:04.817389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6475224-2369-4c37-a60f-39bad20b04cb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:04.817957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6475224-2369-4c37-a60f-39bad20b04cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:04.819685 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6475224-2369-4c37-a60f-39bad20b04cb None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:04.825764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 459/920] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:11:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:04.838178 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6475224-2369-4c37-a60f-39bad20b04cb None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:04.872501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:04.888466 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0fccc-86eb-4107-ab2c-9264df590fc3 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:04.939641 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5576d74-a6d5-4fab-832d-b9eef8c154ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:04.941055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5576d74-a6d5-4fab-832d-b9eef8c154ca None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:04.941562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5576d74-a6d5-4fab-832d-b9eef8c154ca None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:04.942397 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5576d74-a6d5-4fab-832d-b9eef8c154ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:04.947814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:04.961516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5576d74-a6d5-4fab-832d-b9eef8c154ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:04.963397 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5576d74-a6d5-4fab-832d-b9eef8c154ca None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:04.978926 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6475224-2369-4c37-a60f-39bad20b04cb None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-c5576d74-a6d5-4fab-832d-b9eef8c154ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:04.990362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:04.991362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:04.992337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:04.992337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:04.992337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:04.992337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:04.995027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 462/921] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:05.001641 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5576d74-a6d5-4fab-832d-b9eef8c154ca None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:05.032228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19428e56-3ca0-4a86-9e37-932e73f038ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:05.032897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19428e56-3ca0-4a86-9e37-932e73f038ee None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:05.033182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19428e56-3ca0-4a86-9e37-932e73f038ee None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:05.033468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19428e56-3ca0-4a86-9e37-932e73f038ee None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:05.034233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19428e56-3ca0-4a86-9e37-932e73f038ee None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:05.034556 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19428e56-3ca0-4a86-9e37-932e73f038ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:05.036028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19428e56-3ca0-4a86-9e37-932e73f038ee None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:05.047971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 460/922] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 08:11:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:05.049561 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19428e56-3ca0-4a86-9e37-932e73f038ee None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:05.133932 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5576d74-a6d5-4fab-832d-b9eef8c154ca None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:05.185879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:05.187965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846ac3a-c29e-4b27-a237-28339cdc0d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:05.189109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846ac3a-c29e-4b27-a237-28339cdc0d16 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:05.189466 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846ac3a-c29e-4b27-a237-28339cdc0d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:05.189810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846ac3a-c29e-4b27-a237-28339cdc0d16 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:05.191804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846ac3a-c29e-4b27-a237-28339cdc0d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:05.192469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846ac3a-c29e-4b27-a237-28339cdc0d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:05.194281 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846ac3a-c29e-4b27-a237-28339cdc0d16 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:05.197910 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19428e56-3ca0-4a86-9e37-932e73f038ee None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:05.213099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 463/923] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:05.219610 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846ac3a-c29e-4b27-a237-28339cdc0d16 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:05.245065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faad27-f32b-4f52-8822-3758912cdc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:05.245617 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faad27-f32b-4f52-8822-3758912cdc39 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:05.245900 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faad27-f32b-4f52-8822-3758912cdc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:05.246330 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faad27-f32b-4f52-8822-3758912cdc39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:05.247143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43faad27-f32b-4f52-8822-3758912cdc39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:05.248716 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43faad27-f32b-4f52-8822-3758912cdc39 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:05.276264 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 461/924] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:11:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:11:05.284427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:05.346155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846ac3a-c29e-4b27-a237-28339cdc0d16 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:05.398790 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75560249-478b-42a1-8abf-182fcf3a5dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:05.399467 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75560249-478b-42a1-8abf-182fcf3a5dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:05.399748 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75560249-478b-42a1-8abf-182fcf3a5dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:05.400027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75560249-478b-42a1-8abf-182fcf3a5dc5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:05.409393 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75560249-478b-42a1-8abf-182fcf3a5dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:05.411670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75560249-478b-42a1-8abf-182fcf3a5dc5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-75560249-478b-42a1-8abf-182fcf3a5dc5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:11:05.428722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:05.429825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:05.430822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:05.430822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:05.430822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:11:05.430822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:11:05.430822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:11:05.430822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:11:05.430822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:11:05.430822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:11:05.430822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:11:05.430822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:05.434477 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 464/925] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 08:11:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:05.436969 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faad27-f32b-4f52-8822-3758912cdc39 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:05.565873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faad27-f32b-4f52-8822-3758912cdc39 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:05.628319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca0e2a-1215-44b6-bcea-f32faa40c338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:05.629377 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca0e2a-1215-44b6-bcea-f32faa40c338 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:05.629848 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca0e2a-1215-44b6-bcea-f32faa40c338 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:05.630346 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca0e2a-1215-44b6-bcea-f32faa40c338 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:05.631818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca0e2a-1215-44b6-bcea-f32faa40c338 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:05.632352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca0e2a-1215-44b6-bcea-f32faa40c338 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:05.635139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca0e2a-1215-44b6-bcea-f32faa40c338 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:05.664615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 462/926] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 08:11:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:05.671965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75560249-478b-42a1-8abf-182fcf3a5dc5 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:05.737013 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71dee4-0ba5-412a-9aee-cd560b86babe None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:05.737707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71dee4-0ba5-412a-9aee-cd560b86babe None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:05.738563 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71dee4-0ba5-412a-9aee-cd560b86babe None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:05.740692 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 463/927] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:11:05.746286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a041d-dda4-4362-9e93-59c88755c6cf None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:05.746892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a041d-dda4-4362-9e93-59c88755c6cf None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:05.747592 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a041d-dda4-4362-9e93-59c88755c6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:05.766313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:05.772439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-273a041d-dda4-4362-9e93-59c88755c6cf None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:05.773929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-273a041d-dda4-4362-9e93-59c88755c6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:05.801682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75560249-478b-42a1-8abf-182fcf3a5dc5 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:05.803486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:05.843451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388db168-39c8-4f7d-889c-2e48428f3b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:05.844380 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388db168-39c8-4f7d-889c-2e48428f3b14 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:05.844815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388db168-39c8-4f7d-889c-2e48428f3b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:05.845246 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388db168-39c8-4f7d-889c-2e48428f3b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:05.859340 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388db168-39c8-4f7d-889c-2e48428f3b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:05.861081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388db168-39c8-4f7d-889c-2e48428f3b14 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:05.862250 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 464/928] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-388db168-39c8-4f7d-889c-2e48428f3b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:05.877859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:05.879082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:05.880275 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:05.880275 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:05.880275 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:05.880275 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:05.886615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a041d-dda4-4362-9e93-59c88755c6cf None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:05.887091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 465/929] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:05.888214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388db168-39c8-4f7d-889c-2e48428f3b14 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:06.002155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a041d-dda4-4362-9e93-59c88755c6cf None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:06.015728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388db168-39c8-4f7d-889c-2e48428f3b14 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:06.046031 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e65cb-4ac0-45b5-8b67-712aff0ce473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:06.047002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e65cb-4ac0-45b5-8b67-712aff0ce473 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:06.047436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e65cb-4ac0-45b5-8b67-712aff0ce473 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:06.047847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e65cb-4ac0-45b5-8b67-712aff0ce473 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:06.048854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e65cb-4ac0-45b5-8b67-712aff0ce473 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:06.050644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705e65cb-4ac0-45b5-8b67-712aff0ce473 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:06.053654 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:06.058167 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c65ae6-7559-49fd-b76c-7611efd2649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:06.059201 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c65ae6-7559-49fd-b76c-7611efd2649d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:06.059620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c65ae6-7559-49fd-b76c-7611efd2649d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:06.059974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c65ae6-7559-49fd-b76c-7611efd2649d None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:06.060823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c65ae6-7559-49fd-b76c-7611efd2649d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:06.061120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c65ae6-7559-49fd-b76c-7611efd2649d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:06.062547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c65ae6-7559-49fd-b76c-7611efd2649d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-705e65cb-4ac0-45b5-8b67-712aff0ce473 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:06.065427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:06.067381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:06.069017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 465/930] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 08:11:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:06.072118 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f4115-b59a-41de-b676-c7790daaeff6 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:06.072118 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f4115-b59a-41de-b676-c7790daaeff6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:06.072118 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f4115-b59a-41de-b676-c7790daaeff6 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:06.074055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 466/931] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:06.074867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f4115-b59a-41de-b676-c7790daaeff6 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:06.090037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 466/932] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:06.091315 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44590c-48f8-40ed-a305-692bc0f3713a None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:06.092292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44590c-48f8-40ed-a305-692bc0f3713a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:06.092728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44590c-48f8-40ed-a305-692bc0f3713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:06.118657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-bf44590c-48f8-40ed-a305-692bc0f3713a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:06.119870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bf44590c-48f8-40ed-a305-692bc0f3713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:06.139032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:06.226833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f4115-b59a-41de-b676-c7790daaeff6 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:06.240487 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 467/933] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:06.243287 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44590c-48f8-40ed-a305-692bc0f3713a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:06.289061 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3637c5-136c-4366-87a5-423db7dcdb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:06.290783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3637c5-136c-4366-87a5-423db7dcdb1d None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:06.290783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3637c5-136c-4366-87a5-423db7dcdb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:06.291125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3637c5-136c-4366-87a5-423db7dcdb1d None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:06.292130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3637c5-136c-4366-87a5-423db7dcdb1d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:06.292582 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3637c5-136c-4366-87a5-423db7dcdb1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:06.294916 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3637c5-136c-4366-87a5-423db7dcdb1d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:06.307185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 467/934] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 08:11:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:06.307185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3637c5-136c-4366-87a5-423db7dcdb1d None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:06.385251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44590c-48f8-40ed-a305-692bc0f3713a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:06.400142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:06.434863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013954-a9d2-4691-a1a5-26e1bdcb0483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:06.436021 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013954-a9d2-4691-a1a5-26e1bdcb0483 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:06.436403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013954-a9d2-4691-a1a5-26e1bdcb0483 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:06.436847 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19013954-a9d2-4691-a1a5-26e1bdcb0483 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:06.449698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19013954-a9d2-4691-a1a5-26e1bdcb0483 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:06.452739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19013954-a9d2-4691-a1a5-26e1bdcb0483 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:06.452911 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3637c5-136c-4366-87a5-423db7dcdb1d None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-19013954-a9d2-4691-a1a5-26e1bdcb0483 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:11:06.467663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:06.468812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:06.469775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:11:06.469775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:11:06.469775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:11:06.469775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:11:06.469775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:11:06.469775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:11:06.469775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:06.469775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:06.469775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 468/935] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:11:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:06.470335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013954-a9d2-4691-a1a5-26e1bdcb0483 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:06.475386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:06.503524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386f30e-fbc0-4624-a1c5-9ef34c2b3dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:06.504219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386f30e-fbc0-4624-a1c5-9ef34c2b3dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:06.504484 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386f30e-fbc0-4624-a1c5-9ef34c2b3dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:06.504762 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386f30e-fbc0-4624-a1c5-9ef34c2b3dd3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:06.505490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386f30e-fbc0-4624-a1c5-9ef34c2b3dd3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:06.507009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386f30e-fbc0-4624-a1c5-9ef34c2b3dd3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-6386f30e-fbc0-4624-a1c5-9ef34c2b3dd3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:06.518410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:06.519577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:06.525819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 468/936] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Aug 2 08:11:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:06.526929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386f30e-fbc0-4624-a1c5-9ef34c2b3dd3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:06.609866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19013954-a9d2-4691-a1a5-26e1bdcb0483 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:06.640783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386f30e-fbc0-4624-a1c5-9ef34c2b3dd3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:06.652768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9798e-feb0-4b54-94a1-1ee8c4f84b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:06.653421 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9798e-feb0-4b54-94a1-1ee8c4f84b8f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:06.653702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9798e-feb0-4b54-94a1-1ee8c4f84b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:06.653983 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9798e-feb0-4b54-94a1-1ee8c4f84b8f None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:06.654745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9798e-feb0-4b54-94a1-1ee8c4f84b8f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:06.655055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9798e-feb0-4b54-94a1-1ee8c4f84b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:06.656501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9798e-feb0-4b54-94a1-1ee8c4f84b8f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:06.662971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 469/937] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 08:11:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:06.663863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9798e-feb0-4b54-94a1-1ee8c4f84b8f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:06.681571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:06.695081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f377b7-8d43-4299-a8ec-0483ac0cf636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:06.695719 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f377b7-8d43-4299-a8ec-0483ac0cf636 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:06.696006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f377b7-8d43-4299-a8ec-0483ac0cf636 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:06.696286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f377b7-8d43-4299-a8ec-0483ac0cf636 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:06.697057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f377b7-8d43-4299-a8ec-0483ac0cf636 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:06.697373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f377b7-8d43-4299-a8ec-0483ac0cf636 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:06.698868 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f377b7-8d43-4299-a8ec-0483ac0cf636 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:06.713192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 469/938] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:11:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:06.719780 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f377b7-8d43-4299-a8ec-0483ac0cf636 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:06.760593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:06.802174 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9798e-feb0-4b54-94a1-1ee8c4f84b8f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:06.843704 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999fbe6-6788-4e52-82ea-e61679ef64ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:06.844438 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999fbe6-6788-4e52-82ea-e61679ef64ac None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:06.844722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999fbe6-6788-4e52-82ea-e61679ef64ac None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:06.845139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999fbe6-6788-4e52-82ea-e61679ef64ac None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:06.845785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999fbe6-6788-4e52-82ea-e61679ef64ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:06.846119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999fbe6-6788-4e52-82ea-e61679ef64ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:06.847485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5999fbe6-6788-4e52-82ea-e61679ef64ac None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:06.847872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f377b7-8d43-4299-a8ec-0483ac0cf636 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:06.858124 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 470/939] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 08:11:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:06.858124 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999fbe6-6788-4e52-82ea-e61679ef64ac None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:06.892113 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c200aef-3600-4b56-9514-26043b908d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:06.892662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c200aef-3600-4b56-9514-26043b908d78 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:06.892946 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c200aef-3600-4b56-9514-26043b908d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:06.893221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c200aef-3600-4b56-9514-26043b908d78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:06.893988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c200aef-3600-4b56-9514-26043b908d78 None admin] RBAC: Adding query filter params (interface=public, service_id=cf5e3f9cae004b27b39acd57a3f8ebde, region_id=RegionOne) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:06.894326 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c200aef-3600-4b56-9514-26043b908d78 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:06.896012 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c200aef-3600-4b56-9514-26043b908d78 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:06.901504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 470/940] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 08:11:06 2022] GET /identity/v3/endpoints?service_id=cf5e3f9cae004b27b39acd57a3f8ebde&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:06.901504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c200aef-3600-4b56-9514-26043b908d78 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:06.985364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:06.987003 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999fbe6-6788-4e52-82ea-e61679ef64ac None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:07.019239 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:07.025099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3076-3397-4e1b-a423-7badd125b2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:07.025782 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3076-3397-4e1b-a423-7badd125b2b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:07.026087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3076-3397-4e1b-a423-7badd125b2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:07.026370 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3076-3397-4e1b-a423-7badd125b2b5 None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/ad48c627d5d142489f40584eea36a17f/roles/ffef296fbbfa4bdb94ad2fc75f4e92f2` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:07.028573 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab3076-3397-4e1b-a423-7badd125b2b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=ad48c627d5d142489f40584eea36a17f, role_id=ffef296fbbfa4bdb94ad2fc75f4e92f2)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:07.030608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fab3076-3397-4e1b-a423-7badd125b2b5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:07.045589 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c200aef-3600-4b56-9514-26043b908d78 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:07.045843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 471/941] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:11:06 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/ad48c627d5d142489f40584eea36a17f/roles/ffef296fbbfa4bdb94ad2fc75f4e92f2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:11:07.046668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3076-3397-4e1b-a423-7badd125b2b5 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:07.089535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e719cb-c556-41a5-86fd-cbd038852726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:07.090320 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e719cb-c556-41a5-86fd-cbd038852726 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:07.090687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e719cb-c556-41a5-86fd-cbd038852726 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:07.091018 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e719cb-c556-41a5-86fd-cbd038852726 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:07.092322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e719cb-c556-41a5-86fd-cbd038852726 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:07.092706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e719cb-c556-41a5-86fd-cbd038852726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:07.094756 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e719cb-c556-41a5-86fd-cbd038852726 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:07.106874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 471/942] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 08:11:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:07.108593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e719cb-c556-41a5-86fd-cbd038852726 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:07.225022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab3076-3397-4e1b-a423-7badd125b2b5 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:07.262488 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e719cb-c556-41a5-86fd-cbd038852726 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:07.287797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:07.288967 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c1f66-802c-4509-a0cd-0ab4ce4a45ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:07.290420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c1f66-802c-4509-a0cd-0ab4ce4a45ea None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:07.291067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c1f66-802c-4509-a0cd-0ab4ce4a45ea None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:07.291799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c1f66-802c-4509-a0cd-0ab4ce4a45ea None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:07.292654 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c1f66-802c-4509-a0cd-0ab4ce4a45ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:07.296292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c1f66-802c-4509-a0cd-0ab4ce4a45ea None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:07.306162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 472/943] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 08:11:07 2022] GET /identity/v3/services => generated 1497 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:11:07.321700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6066de-a826-4c00-a5aa-ebed26f077bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:07.322392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6066de-a826-4c00-a5aa-ebed26f077bb None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:07.322673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6066de-a826-4c00-a5aa-ebed26f077bb None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:07.322947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6066de-a826-4c00-a5aa-ebed26f077bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:07.323687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6066de-a826-4c00-a5aa-ebed26f077bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:07.325090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6066de-a826-4c00-a5aa-ebed26f077bb None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:07.350541 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 472/944] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:11:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:11:07.643505 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a34280-866a-4b2e-912d-7108d4effe90 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:07.644015 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a34280-866a-4b2e-912d-7108d4effe90 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:07.644448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a34280-866a-4b2e-912d-7108d4effe90 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:07.646401 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 473/945] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:07.652242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b337bbe-c58a-474e-80b3-7e7628d58f81 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:07.653210 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b337bbe-c58a-474e-80b3-7e7628d58f81 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:07.653691 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b337bbe-c58a-474e-80b3-7e7628d58f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:07.674486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3b337bbe-c58a-474e-80b3-7e7628d58f81 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:07.676108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3b337bbe-c58a-474e-80b3-7e7628d58f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:07.763613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 473/946] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:07.787005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a34280-866a-4b2e-912d-7108d4effe90 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:07.852079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:07.904492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a34280-866a-4b2e-912d-7108d4effe90 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:07.942595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4bb73-70ee-4340-a05d-4b1cf62f0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:07.943351 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4bb73-70ee-4340-a05d-4b1cf62f0b92 None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:07.943635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4bb73-70ee-4340-a05d-4b1cf62f0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:07.943906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4bb73-70ee-4340-a05d-4b1cf62f0b92 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:07.944879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4bb73-70ee-4340-a05d-4b1cf62f0b92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:07.946666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4bb73-70ee-4340-a05d-4b1cf62f0b92 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:07.949799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: WARNING keystone.server.flask.common [None req-b9a4bb73-70ee-4340-a05d-4b1cf62f0b92 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 08:11:07.974200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.sql.core [None req-b9a4bb73-70ee-4340-a05d-4b1cf62f0b92 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 08:11:07.974200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 08:11:07.974200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [parameters: {'id': 'c733b8e212c14d5e8108316b19a870bb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 08:11:07.974200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80184) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-b9a4bb73-70ee-4340-a05d-4b1cf62f0b92 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c733b8e212c14d5e8108316b19a870bb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c733b8e212c14d5e8108316b19a870bb. Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:11:07.986929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application result.read() Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 02 08:11:07.987814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application yield resource Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise self.value Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application session.commit() Aug 02 08:11:07.988767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self.session.flush() Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application compat.raise_( Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 08:11:07.989660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 08:11:07.990589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application result.read() Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:11:07.991388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [parameters: {'id': 'c733b8e212c14d5e8108316b19a870bb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:07.992280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:07.993082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:07.993999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:07.993999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 02 08:11:07.993999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 02 08:11:07.993999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:07.993999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:07.993999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 02 08:11:07.993999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 02 08:11:07.993999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c733b8e212c14d5e8108316b19a870bb. Aug 02 08:11:07.993999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:07.993999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 474/947] 10.222.0.57 () {60 vars in 1140 bytes} [Tue Aug 2 08:11:07 2022] POST /identity/v3/projects => generated 262 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:08.003253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b337bbe-c58a-474e-80b3-7e7628d58f81 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:08.166508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:08.170155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b337bbe-c58a-474e-80b3-7e7628d58f81 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:08.221316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277e4ca-8c37-4b5e-a75c-eecd3ab451f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:08.222280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277e4ca-8c37-4b5e-a75c-eecd3ab451f4 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:08.222686 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277e4ca-8c37-4b5e-a75c-eecd3ab451f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:08.223080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277e4ca-8c37-4b5e-a75c-eecd3ab451f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:08.234729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277e4ca-8c37-4b5e-a75c-eecd3ab451f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:08.237010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277e4ca-8c37-4b5e-a75c-eecd3ab451f4 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-b277e4ca-8c37-4b5e-a75c-eecd3ab451f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:11:08.256095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:08.257064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:08.257957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:11:08.257957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:11:08.257957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:11:08.257957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:11:08.257957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:11:08.257957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:11:08.257957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:08.257957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:08.258499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 474/948] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:11:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:08.266538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4bb73-70ee-4340-a05d-4b1cf62f0b92 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:08.388281 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4bb73-70ee-4340-a05d-4b1cf62f0b92 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:08.438513 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:08.441528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2618abf-8a6e-4ee4-abb9-840b9cd925a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:08.442652 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2618abf-8a6e-4ee4-abb9-840b9cd925a8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:08.443114 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2618abf-8a6e-4ee4-abb9-840b9cd925a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:08.443633 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2618abf-8a6e-4ee4-abb9-840b9cd925a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:08.444988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2618abf-8a6e-4ee4-abb9-840b9cd925a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:08.445505 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2618abf-8a6e-4ee4-abb9-840b9cd925a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:08.449197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2618abf-8a6e-4ee4-abb9-840b9cd925a8 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:08.477022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 475/949] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:11:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:09.196703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3006ac-b43f-4e53-b5e4-3317e8d08614 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:09.197391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3006ac-b43f-4e53-b5e4-3317e8d08614 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:09.197391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3006ac-b43f-4e53-b5e4-3317e8d08614 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:09.199003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 475/950] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:09.205576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786a9e-1669-4970-8907-13b46f9c5b06 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:09.206240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786a9e-1669-4970-8907-13b46f9c5b06 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:09.206240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786a9e-1669-4970-8907-13b46f9c5b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:09.226051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-a6786a9e-1669-4970-8907-13b46f9c5b06 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:09.227622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-a6786a9e-1669-4970-8907-13b46f9c5b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:09.304442 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 476/951] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:09.328975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3006ac-b43f-4e53-b5e4-3317e8d08614 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:09.450079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3006ac-b43f-4e53-b5e4-3317e8d08614 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:09.488839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa8435-22ae-4f8b-9d29-51b758827e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:09.489498 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8435-22ae-4f8b-9d29-51b758827e66 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:09.489780 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8435-22ae-4f8b-9d29-51b758827e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:09.490081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8435-22ae-4f8b-9d29-51b758827e66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:09.502876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa8435-22ae-4f8b-9d29-51b758827e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-36fa8435-22ae-4f8b-9d29-51b758827e66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:11:09.508812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:09.510515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:09.512010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 476/952] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 08:11:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:09.518039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786a9e-1669-4970-8907-13b46f9c5b06 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:09.564079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eb513-429f-43ec-979b-61927994fb7f None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:09.564400 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eb513-429f-43ec-979b-61927994fb7f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:09.564622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eb513-429f-43ec-979b-61927994fb7f None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:09.565987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 477/953] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:11:09.575536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c99a6a-d17e-4034-91f9-302973e68a39 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:09.575845 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c99a6a-d17e-4034-91f9-302973e68a39 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:09.576121 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c99a6a-d17e-4034-91f9-302973e68a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:09.596592 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-a4c99a6a-d17e-4034-91f9-302973e68a39 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:09.597806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-a4c99a6a-d17e-4034-91f9-302973e68a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:09.610047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:09.643270 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786a9e-1669-4970-8907-13b46f9c5b06 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:09.644848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:09.676631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 478/954] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:09.679348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a414-d14f-4cad-a780-3c2b5f96f3c1 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:09.679629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a414-d14f-4cad-a780-3c2b5f96f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:09.679899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3a414-d14f-4cad-a780-3c2b5f96f3c1 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:09.682186 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 479/955] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:09.688167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6004c0-1df2-4431-8ced-0beb24b50da1 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:09.688447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6004c0-1df2-4431-8ced-0beb24b50da1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:09.688719 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6004c0-1df2-4431-8ced-0beb24b50da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:09.693451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fefc05-b805-4208-bfb1-35f5dc2cf01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:09.694422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fefc05-b805-4208-bfb1-35f5dc2cf01e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:09.695265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fefc05-b805-4208-bfb1-35f5dc2cf01e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:09.695749 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fefc05-b805-4208-bfb1-35f5dc2cf01e None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:09.697727 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fefc05-b805-4208-bfb1-35f5dc2cf01e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:09.698276 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fefc05-b805-4208-bfb1-35f5dc2cf01e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:09.700199 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fefc05-b805-4208-bfb1-35f5dc2cf01e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:09.708580 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-5f6004c0-1df2-4431-8ced-0beb24b50da1 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:09.709791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-5f6004c0-1df2-4431-8ced-0beb24b50da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:09.710992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 477/956] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 08:11:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:09.714221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fefc05-b805-4208-bfb1-35f5dc2cf01e None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:09.789909 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 480/957] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:09.791622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6004c0-1df2-4431-8ced-0beb24b50da1 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:09.840810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fefc05-b805-4208-bfb1-35f5dc2cf01e None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:09.879722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f39b-9311-424c-8108-17a830b11505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:09.880369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f39b-9311-424c-8108-17a830b11505 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:09.880651 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f39b-9311-424c-8108-17a830b11505 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:09.880933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f39b-9311-424c-8108-17a830b11505 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:09.881571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348f39b-9311-424c-8108-17a830b11505 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:09.882978 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348f39b-9311-424c-8108-17a830b11505 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-5348f39b-9311-424c-8108-17a830b11505 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:09.892574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:09.893793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:09.894834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:09.895688 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:09.895772 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 478/958] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 08:11:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:09.895772 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f39b-9311-424c-8108-17a830b11505 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:09.924728 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6004c0-1df2-4431-8ced-0beb24b50da1 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:09.934233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:09.964455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3dc43-8408-4747-bdf2-789eea5e1b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:09.965016 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3dc43-8408-4747-bdf2-789eea5e1b97 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:09.965295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3dc43-8408-4747-bdf2-789eea5e1b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:09.965567 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3dc43-8408-4747-bdf2-789eea5e1b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:09.977788 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3dc43-8408-4747-bdf2-789eea5e1b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:09.979520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3dc43-8408-4747-bdf2-789eea5e1b97 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-16f3dc43-8408-4747-bdf2-789eea5e1b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:09.995975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:09.997258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:09.998252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:09.998252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:09.998252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:09.998252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:09.998252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 481/959] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:09.998252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3dc43-8408-4747-bdf2-789eea5e1b97 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:10.026805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f39b-9311-424c-8108-17a830b11505 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:10.064518 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb253547-2245-4545-9407-1f437abac1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:10.065171 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb253547-2245-4545-9407-1f437abac1ed None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:10.065447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb253547-2245-4545-9407-1f437abac1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:10.065723 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb253547-2245-4545-9407-1f437abac1ed None admin] PATH_INFO: `/v3/services/compute` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:10.066433 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb253547-2245-4545-9407-1f437abac1ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:10.067791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb253547-2245-4545-9407-1f437abac1ed None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-fb253547-2245-4545-9407-1f437abac1ed None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:10.077111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:10.078209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:11:10.079086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:10.083451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 479/960] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:11:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:10.084493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb253547-2245-4545-9407-1f437abac1ed None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:10.108984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3dc43-8408-4747-bdf2-789eea5e1b97 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:10.137118 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:10.147565 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b7778-de1b-45bb-a9ab-00c395cd37b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:10.148192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b7778-de1b-45bb-a9ab-00c395cd37b1 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:10.148474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b7778-de1b-45bb-a9ab-00c395cd37b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:10.148756 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b7778-de1b-45bb-a9ab-00c395cd37b1 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:10.149478 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b7778-de1b-45bb-a9ab-00c395cd37b1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:10.149790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b7778-de1b-45bb-a9ab-00c395cd37b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:10.151275 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b7778-de1b-45bb-a9ab-00c395cd37b1 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:10.162549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 482/961] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 08:11:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:10.162549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b7778-de1b-45bb-a9ab-00c395cd37b1 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:10.205605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:10.220089 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb253547-2245-4545-9407-1f437abac1ed None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:10.259353 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305ab01-5cea-4b44-9e25-f1293c854096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:10.259986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ab01-5cea-4b44-9e25-f1293c854096 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:10.260382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ab01-5cea-4b44-9e25-f1293c854096 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:10.260637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305ab01-5cea-4b44-9e25-f1293c854096 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:10.262789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305ab01-5cea-4b44-9e25-f1293c854096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:10.262789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305ab01-5cea-4b44-9e25-f1293c854096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:10.262789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305ab01-5cea-4b44-9e25-f1293c854096 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:10.275394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 480/962] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:10.276318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305ab01-5cea-4b44-9e25-f1293c854096 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:10.286741 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b7778-de1b-45bb-a9ab-00c395cd37b1 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:10.326873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c12de2-a626-475e-b6ad-e21a6920e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:10.328339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c12de2-a626-475e-b6ad-e21a6920e83f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:10.328831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c12de2-a626-475e-b6ad-e21a6920e83f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:10.329196 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c12de2-a626-475e-b6ad-e21a6920e83f None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:10.329944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c12de2-a626-475e-b6ad-e21a6920e83f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:10.330310 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c12de2-a626-475e-b6ad-e21a6920e83f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:10.331948 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c12de2-a626-475e-b6ad-e21a6920e83f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:10.337508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 483/963] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:11:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:10.338354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c12de2-a626-475e-b6ad-e21a6920e83f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:10.408127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305ab01-5cea-4b44-9e25-f1293c854096 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:10.408763 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:10.448472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5109c4-b52b-4c7e-9f92-062d2dea70ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:10.449098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5109c4-b52b-4c7e-9f92-062d2dea70ac None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:10.449380 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5109c4-b52b-4c7e-9f92-062d2dea70ac None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:10.449657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5109c4-b52b-4c7e-9f92-062d2dea70ac None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:10.450405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5109c4-b52b-4c7e-9f92-062d2dea70ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:10.450713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5109c4-b52b-4c7e-9f92-062d2dea70ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:10.452884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5109c4-b52b-4c7e-9f92-062d2dea70ac None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:10.462928 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 481/964] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 08:11:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:10.462928 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5109c4-b52b-4c7e-9f92-062d2dea70ac None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:10.463244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c12de2-a626-475e-b6ad-e21a6920e83f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:10.484603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:10.503943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e800c-8ff1-45f2-9ea1-59e85ea40625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:10.504750 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e800c-8ff1-45f2-9ea1-59e85ea40625 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:10.505094 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e800c-8ff1-45f2-9ea1-59e85ea40625 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:10.505456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e800c-8ff1-45f2-9ea1-59e85ea40625 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:10.515851 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e800c-8ff1-45f2-9ea1-59e85ea40625 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:10.517419 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e800c-8ff1-45f2-9ea1-59e85ea40625 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-074e800c-8ff1-45f2-9ea1-59e85ea40625 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:11:10.530379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:10.531440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:10.532401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:10.532401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:10.532401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:11:10.532401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:11:10.532401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:11:10.532401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:11:10.532401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:11:10.532401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:11:10.532401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 08:11:10.532401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:10.532401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 484/965] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 08:11:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:10.533019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e800c-8ff1-45f2-9ea1-59e85ea40625 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:10.589560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5109c4-b52b-4c7e-9f92-062d2dea70ac None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:10.630277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edc3b6-515e-45ef-88d5-ede8206306a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:10.631030 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edc3b6-515e-45ef-88d5-ede8206306a8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:10.631318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edc3b6-515e-45ef-88d5-ede8206306a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:10.631598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11edc3b6-515e-45ef-88d5-ede8206306a8 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:10.632290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edc3b6-515e-45ef-88d5-ede8206306a8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:10.632598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edc3b6-515e-45ef-88d5-ede8206306a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:10.633985 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11edc3b6-515e-45ef-88d5-ede8206306a8 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:10.640003 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 482/966] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:11:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:10.640905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edc3b6-515e-45ef-88d5-ede8206306a8 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:10.662683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e800c-8ff1-45f2-9ea1-59e85ea40625 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:10.682694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:10.705480 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a373f28-5279-4dd4-bbaf-07cffe6e9cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:10.706542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373f28-5279-4dd4-bbaf-07cffe6e9cc3 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:10.706826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373f28-5279-4dd4-bbaf-07cffe6e9cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:10.707106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373f28-5279-4dd4-bbaf-07cffe6e9cc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:10.707885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a373f28-5279-4dd4-bbaf-07cffe6e9cc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:10.709332 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a373f28-5279-4dd4-bbaf-07cffe6e9cc3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:10.750760 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 485/967] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:11:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:11:10.762626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed73d9d-a6f2-4d7c-aadb-e59b205256b6 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:10.762952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed73d9d-a6f2-4d7c-aadb-e59b205256b6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:10.763182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed73d9d-a6f2-4d7c-aadb-e59b205256b6 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:10.766807 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 486/968] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:11:10.772074 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93bb27-bb5b-49dc-8280-d06cb031d720 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:10.772451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93bb27-bb5b-49dc-8280-d06cb031d720 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:10.772637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93bb27-bb5b-49dc-8280-d06cb031d720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:10.792156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:10.793483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-eb93bb27-bb5b-49dc-8280-d06cb031d720 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:10.795384 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-eb93bb27-bb5b-49dc-8280-d06cb031d720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:10.820365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11edc3b6-515e-45ef-88d5-ede8206306a8 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:10.881395 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ede40e-d1a1-4859-bbb7-c835b84c698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:10.882464 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ede40e-d1a1-4859-bbb7-c835b84c698f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:10.882753 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ede40e-d1a1-4859-bbb7-c835b84c698f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:10.883029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ede40e-d1a1-4859-bbb7-c835b84c698f None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:10.884424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ede40e-d1a1-4859-bbb7-c835b84c698f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:10.884736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ede40e-d1a1-4859-bbb7-c835b84c698f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:10.886344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ede40e-d1a1-4859-bbb7-c835b84c698f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:10.923005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 483/969] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 08:11:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:10.930250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ede40e-d1a1-4859-bbb7-c835b84c698f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:10.933871 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 487/970] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:11:10.960252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93bb27-bb5b-49dc-8280-d06cb031d720 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:11.063734 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ede40e-d1a1-4859-bbb7-c835b84c698f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:11.091318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93bb27-bb5b-49dc-8280-d06cb031d720 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:11.093083 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:11.105328 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807abdef-90dd-4743-8136-7f56df4389a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:11.105975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807abdef-90dd-4743-8136-7f56df4389a1 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:11.106292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807abdef-90dd-4743-8136-7f56df4389a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:11.106713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807abdef-90dd-4743-8136-7f56df4389a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:11.111311 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:11.136327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca04c2-8a36-4fdd-8c62-e12f0a84fbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:11.137097 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca04c2-8a36-4fdd-8c62-e12f0a84fbb4 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:11.137389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca04c2-8a36-4fdd-8c62-e12f0a84fbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:11.137670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca04c2-8a36-4fdd-8c62-e12f0a84fbb4 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:11.138424 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca04c2-8a36-4fdd-8c62-e12f0a84fbb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:11.140185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca04c2-8a36-4fdd-8c62-e12f0a84fbb4 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:11.143204 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: WARNING keystone.server.flask.common [None req-76ca04c2-8a36-4fdd-8c62-e12f0a84fbb4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 08:11:11.157838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.sql.core [None req-76ca04c2-8a36-4fdd-8c62-e12f0a84fbb4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 08:11:11.157838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 08:11:11.157838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [parameters: {'user_id': 'd74a43bda521498bbfc338510ac283ed', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 08:11:11.157838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80183) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-76ca04c2-8a36-4fdd-8c62-e12f0a84fbb4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application result.read() Aug 02 08:11:11.177843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:11:11.178825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application yield resource Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application next(self.gen) Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise self.value Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application session.commit() Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 08:11:11.180837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self.session.flush() Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application compat.raise_( Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 08:11:11.183021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 08:11:11.185060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application conn.query(q) Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application result.read() Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 08:11:11.187513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd74a43bda521498bbfc338510ac283ed', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:11.189358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 02 08:11:11.199169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 02 08:11:11.201037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 02 08:11:11.201037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 02 08:11:11.201037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 08:11:11.201037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 08:11:11.201037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 08:11:11.201037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:11.201037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 488/971] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 2 08:11:10 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:11.201037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca04c2-8a36-4fdd-8c62-e12f0a84fbb4 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:11.202043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807abdef-90dd-4743-8136-7f56df4389a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:11.202043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807abdef-90dd-4743-8136-7f56df4389a1 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:11.318299 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca04c2-8a36-4fdd-8c62-e12f0a84fbb4 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:11.346031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 484/972] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:11:10 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:11:11.356688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807abdef-90dd-4743-8136-7f56df4389a1 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:11.380749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a48c9-8870-447d-a6c7-75bbe8e8aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:11.381728 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a48c9-8870-447d-a6c7-75bbe8e8aefa None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:11.382036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a48c9-8870-447d-a6c7-75bbe8e8aefa None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:11.382766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a48c9-8870-447d-a6c7-75bbe8e8aefa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:11.394454 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a48c9-8870-447d-a6c7-75bbe8e8aefa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:11.397578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a48c9-8870-447d-a6c7-75bbe8e8aefa None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:11.399809 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-499a48c9-8870-447d-a6c7-75bbe8e8aefa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:11:11.417224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:11.418436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:11.419408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:11.419408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:11.419408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:11:11.419408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:11:11.419408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:11:11.419408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:11:11.419408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:11:11.419408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:11:11.419408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 08:11:11.419408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:11.422577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 489/973] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:11:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:11.428161 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a48c9-8870-447d-a6c7-75bbe8e8aefa None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:11.468086 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:11.498701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807abdef-90dd-4743-8136-7f56df4389a1 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:11.539063 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa35e52-7de1-4e0a-b05d-a6f9eaf3d16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:11.540395 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa35e52-7de1-4e0a-b05d-a6f9eaf3d16b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:11.541033 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa35e52-7de1-4e0a-b05d-a6f9eaf3d16b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:11.541519 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa35e52-7de1-4e0a-b05d-a6f9eaf3d16b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:11.554640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa35e52-7de1-4e0a-b05d-a6f9eaf3d16b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:11.556645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa35e52-7de1-4e0a-b05d-a6f9eaf3d16b None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:11.558690 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a48c9-8870-447d-a6c7-75bbe8e8aefa None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-1aa35e52-7de1-4e0a-b05d-a6f9eaf3d16b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:11.574855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:11.575855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:11.576784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:11.576784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:11.576784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:11.576784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:11.579382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 485/974] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:11.589426 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa35e52-7de1-4e0a-b05d-a6f9eaf3d16b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:11.599049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b215e-3f14-4a7a-8ab5-65733e0ece05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:11.599971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b215e-3f14-4a7a-8ab5-65733e0ece05 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:11.600943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b215e-3f14-4a7a-8ab5-65733e0ece05 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:11.601390 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b215e-3f14-4a7a-8ab5-65733e0ece05 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:11.603145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b215e-3f14-4a7a-8ab5-65733e0ece05 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:11.603627 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b215e-3f14-4a7a-8ab5-65733e0ece05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:11.605574 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b215e-3f14-4a7a-8ab5-65733e0ece05 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:11.678429 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 490/975] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 08:11:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:11.707771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:11.734240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa35e52-7de1-4e0a-b05d-a6f9eaf3d16b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:11.793768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca900-2e7f-488d-93d5-e631159da86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:11.795315 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca900-2e7f-488d-93d5-e631159da86c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:11.795742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca900-2e7f-488d-93d5-e631159da86c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:11.796151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca900-2e7f-488d-93d5-e631159da86c None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:11.797253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ca900-2e7f-488d-93d5-e631159da86c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:11.797734 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ca900-2e7f-488d-93d5-e631159da86c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:11.800177 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ca900-2e7f-488d-93d5-e631159da86c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:11.826457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 486/976] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:11.831499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b215e-3f14-4a7a-8ab5-65733e0ece05 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:11.948465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:11.971331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b215e-3f14-4a7a-8ab5-65733e0ece05 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:12.011901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa996686-4f4c-4eac-b6e0-7e156c299d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:12.012570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa996686-4f4c-4eac-b6e0-7e156c299d47 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:12.012859 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa996686-4f4c-4eac-b6e0-7e156c299d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:12.013134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa996686-4f4c-4eac-b6e0-7e156c299d47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:12.023487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa996686-4f4c-4eac-b6e0-7e156c299d47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:12.025407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa996686-4f4c-4eac-b6e0-7e156c299d47 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-aa996686-4f4c-4eac-b6e0-7e156c299d47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:11:12.039624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:12.040925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:12.041908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:11:12.041908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:11:12.041908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:11:12.041908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:11:12.041908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:11:12.041908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:11:12.041908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:12.041908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:12.043062 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 491/977] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:11:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:12.048723 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca900-2e7f-488d-93d5-e631159da86c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:12.170250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca900-2e7f-488d-93d5-e631159da86c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:12.206273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bafa23-fb90-4edf-820e-83ef85d384ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:12.206894 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bafa23-fb90-4edf-820e-83ef85d384ff None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:12.207173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bafa23-fb90-4edf-820e-83ef85d384ff None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:12.207442 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bafa23-fb90-4edf-820e-83ef85d384ff None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:12.208199 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bafa23-fb90-4edf-820e-83ef85d384ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:12.208503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bafa23-fb90-4edf-820e-83ef85d384ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:12.209931 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bafa23-fb90-4edf-820e-83ef85d384ff None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:12.223780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 487/978] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:11:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:12.229752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa996686-4f4c-4eac-b6e0-7e156c299d47 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:12.348053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa996686-4f4c-4eac-b6e0-7e156c299d47 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:12.392493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef59969-4b36-4fcb-a276-c06a10346fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:12.393121 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59969-4b36-4fcb-a276-c06a10346fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:12.393400 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59969-4b36-4fcb-a276-c06a10346fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:12.393677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59969-4b36-4fcb-a276-c06a10346fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:12.394504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef59969-4b36-4fcb-a276-c06a10346fc5 None admin] RBAC: Adding query filter params (role.id=ffef296fbbfa4bdb94ad2fc75f4e92f2, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=ad48c627d5d142489f40584eea36a17f) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:12.394817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef59969-4b36-4fcb-a276-c06a10346fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:12.396251 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef59969-4b36-4fcb-a276-c06a10346fc5 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:12.414060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 492/979] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:11:12 2022] GET /identity/v3/role_assignments?user.id=ad48c627d5d142489f40584eea36a17f&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=ffef296fbbfa4bdb94ad2fc75f4e92f2 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:12.840781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393c27b-0786-49b0-9d80-db7264563bc4 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:12.841358 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393c27b-0786-49b0-9d80-db7264563bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:12.841358 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393c27b-0786-49b0-9d80-db7264563bc4 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:12.842918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 488/980] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:12.848328 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba427c7-85dc-45c6-8d39-10c4dac20eb5 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:12.848612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba427c7-85dc-45c6-8d39-10c4dac20eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:12.848896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba427c7-85dc-45c6-8d39-10c4dac20eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:12.863580 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:12.870155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3ba427c7-85dc-45c6-8d39-10c4dac20eb5 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:12.871719 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3ba427c7-85dc-45c6-8d39-10c4dac20eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:12.947906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 493/981] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:12.948686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29ea0a-af15-4ecf-9866-8dc7a46e5ddb None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:12.948972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29ea0a-af15-4ecf-9866-8dc7a46e5ddb None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:12.949248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29ea0a-af15-4ecf-9866-8dc7a46e5ddb None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:12.950696 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 489/982] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:11:12.956448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f759445-6640-4eb6-b333-b1772cbe8237 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:12.956745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f759445-6640-4eb6-b333-b1772cbe8237 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:12.956998 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f759445-6640-4eb6-b333-b1772cbe8237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:12.974373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29ea0a-af15-4ecf-9866-8dc7a46e5ddb None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:12.976293 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-5f759445-6640-4eb6-b333-b1772cbe8237 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:12.977501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-5f759445-6640-4eb6-b333-b1772cbe8237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:12.984966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:13.059320 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 494/983] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:13.083114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f759445-6640-4eb6-b333-b1772cbe8237 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:13.100162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29ea0a-af15-4ecf-9866-8dc7a46e5ddb None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:13.141622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab37429-f5c7-487b-905e-92b707235602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:13.142363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37429-f5c7-487b-905e-92b707235602 None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:13.142643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37429-f5c7-487b-905e-92b707235602 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:13.142922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab37429-f5c7-487b-905e-92b707235602 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:13.143789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab37429-f5c7-487b-905e-92b707235602 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:13.145441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab37429-f5c7-487b-905e-92b707235602 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:13.155684 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:13.164707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 490/984] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:11:12 2022] POST /identity/v3/services => generated 242 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:11:13.203592 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f759445-6640-4eb6-b333-b1772cbe8237 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:13.256331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0115b-ddfa-41ab-810a-8427f946658f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:13.257100 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0115b-ddfa-41ab-810a-8427f946658f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:13.257593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0115b-ddfa-41ab-810a-8427f946658f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:13.257826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0115b-ddfa-41ab-810a-8427f946658f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:13.258400 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0115b-ddfa-41ab-810a-8427f946658f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:13.259875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0115b-ddfa-41ab-810a-8427f946658f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-22e0115b-ddfa-41ab-810a-8427f946658f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:13.271247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:13.272344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:13.273241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:13.274932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 495/985] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 08:11:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:13.278331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab37429-f5c7-487b-905e-92b707235602 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:13.370834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:13.416390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab37429-f5c7-487b-905e-92b707235602 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:13.457446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01a10f-bede-4e81-ac37-372103b2b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:13.458240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01a10f-bede-4e81-ac37-372103b2b7ef None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:13.458740 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01a10f-bede-4e81-ac37-372103b2b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:13.459157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01a10f-bede-4e81-ac37-372103b2b7ef None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:13.460222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01a10f-bede-4e81-ac37-372103b2b7ef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:13.460692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01a10f-bede-4e81-ac37-372103b2b7ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:13.462301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01a10f-bede-4e81-ac37-372103b2b7ef None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:13.473205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 491/986] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 08:11:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:13.474579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0115b-ddfa-41ab-810a-8427f946658f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:13.615666 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0115b-ddfa-41ab-810a-8427f946658f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:13.648931 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:13.674201 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9379ef-ce55-48f8-a1c0-bb5d25388c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:13.674834 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9379ef-ce55-48f8-a1c0-bb5d25388c0c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:13.675110 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9379ef-ce55-48f8-a1c0-bb5d25388c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:13.675384 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9379ef-ce55-48f8-a1c0-bb5d25388c0c None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:13.676099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9379ef-ce55-48f8-a1c0-bb5d25388c0c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:13.676376 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9379ef-ce55-48f8-a1c0-bb5d25388c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:13.677751 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9379ef-ce55-48f8-a1c0-bb5d25388c0c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:13.684092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 496/987] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 08:11:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:13.690263 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01a10f-bede-4e81-ac37-372103b2b7ef None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:13.842895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01a10f-bede-4e81-ac37-372103b2b7ef None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:13.880346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:13.889904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4e0ce-953a-4be7-b962-21e324aa5015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:13.890851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4e0ce-953a-4be7-b962-21e324aa5015 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:13.891135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4e0ce-953a-4be7-b962-21e324aa5015 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:13.891412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4e0ce-953a-4be7-b962-21e324aa5015 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:13.892190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4e0ce-953a-4be7-b962-21e324aa5015 None admin] RBAC: Adding query filter params (interface=admin, service_id=cf5e3f9cae004b27b39acd57a3f8ebde, region_id=RegionOne) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:13.892500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4e0ce-953a-4be7-b962-21e324aa5015 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:13.893977 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4e0ce-953a-4be7-b962-21e324aa5015 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:13.903690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 492/988] 10.222.0.57 () {56 vars in 1249 bytes} [Tue Aug 2 08:11:13 2022] GET /identity/v3/endpoints?service_id=cf5e3f9cae004b27b39acd57a3f8ebde&interface=admin®ion_id=RegionOne => generated 193 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:13.909765 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9379ef-ce55-48f8-a1c0-bb5d25388c0c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:14.031895 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9379ef-ce55-48f8-a1c0-bb5d25388c0c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:14.072736 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db108b-c2a9-4e1e-8feb-09b5d24268e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:14.073373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db108b-c2a9-4e1e-8feb-09b5d24268e8 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:14.073732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db108b-c2a9-4e1e-8feb-09b5d24268e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:14.074844 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db108b-c2a9-4e1e-8feb-09b5d24268e8 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:14.074844 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db108b-c2a9-4e1e-8feb-09b5d24268e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:14.076620 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db108b-c2a9-4e1e-8feb-09b5d24268e8 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:14.090056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 497/989] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 08:11:13 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:11:14.527722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998eeca-9528-4409-99dd-7c007f116d85 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:14.528056 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998eeca-9528-4409-99dd-7c007f116d85 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:14.528285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998eeca-9528-4409-99dd-7c007f116d85 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:14.529971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 493/990] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:14.535164 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1b383-27b4-4ebb-a541-ed75817644cb None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:14.535836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1b383-27b4-4ebb-a541-ed75817644cb None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:14.535836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1b383-27b4-4ebb-a541-ed75817644cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:14.555287 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-8fd1b383-27b4-4ebb-a541-ed75817644cb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:14.556499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8fd1b383-27b4-4ebb-a541-ed75817644cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:14.611285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:14.633596 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 498/991] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:14.656949 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998eeca-9528-4409-99dd-7c007f116d85 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:14.770155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998eeca-9528-4409-99dd-7c007f116d85 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:14.806896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c761b80-a7b7-402a-926e-0fa5672d6914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:14.807551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761b80-a7b7-402a-926e-0fa5672d6914 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:14.807837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761b80-a7b7-402a-926e-0fa5672d6914 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:14.808116 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c761b80-a7b7-402a-926e-0fa5672d6914 None admin] PATH_INFO: `/v3/services/image` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:14.808758 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c761b80-a7b7-402a-926e-0fa5672d6914 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:14.810718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c761b80-a7b7-402a-926e-0fa5672d6914 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-3c761b80-a7b7-402a-926e-0fa5672d6914 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:14.820669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:14.821751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:11:14.822627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:14.826377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 494/992] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Aug 2 08:11:14 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:14.828081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1b383-27b4-4ebb-a541-ed75817644cb None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:14.958333 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1b383-27b4-4ebb-a541-ed75817644cb None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:15.014954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5c6c2-cc49-40e6-ba04-6b49394e694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:15.015961 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5c6c2-cc49-40e6-ba04-6b49394e694a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:15.016428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5c6c2-cc49-40e6-ba04-6b49394e694a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:15.016893 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5c6c2-cc49-40e6-ba04-6b49394e694a None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:15.018242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5c6c2-cc49-40e6-ba04-6b49394e694a None admin] RBAC: Adding query filter params (name=image) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:15.018760 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5c6c2-cc49-40e6-ba04-6b49394e694a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:15.021192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5c6c2-cc49-40e6-ba04-6b49394e694a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:15.031387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 499/993] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:15.038460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c761b80-a7b7-402a-926e-0fa5672d6914 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:15.142864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:15.191801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c761b80-a7b7-402a-926e-0fa5672d6914 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:15.230961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c47d4-d4eb-43f1-835f-2bb27da28fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:15.231875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c47d4-d4eb-43f1-835f-2bb27da28fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:15.232830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c47d4-d4eb-43f1-835f-2bb27da28fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:15.233120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c47d4-d4eb-43f1-835f-2bb27da28fb7 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:15.233824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c47d4-d4eb-43f1-835f-2bb27da28fb7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:15.234158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c47d4-d4eb-43f1-835f-2bb27da28fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:15.235557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c47d4-d4eb-43f1-835f-2bb27da28fb7 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:15.241182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 495/994] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:15.244157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecef0c-037c-4e11-8392-2d61cb8eaf72 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:15.244541 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecef0c-037c-4e11-8392-2d61cb8eaf72 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:15.244853 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecef0c-037c-4e11-8392-2d61cb8eaf72 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:15.246601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 500/995] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:15.252873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385aca-b273-417e-ba4d-04295a80f2e0 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:15.253226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385aca-b273-417e-ba4d-04295a80f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:15.253429 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f385aca-b273-417e-ba4d-04295a80f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:15.275224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-5f385aca-b273-417e-ba4d-04295a80f2e0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:15.277884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5f385aca-b273-417e-ba4d-04295a80f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:15.378468 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 496/996] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:15.398245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecef0c-037c-4e11-8392-2d61cb8eaf72 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:15.460335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:15.529220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecef0c-037c-4e11-8392-2d61cb8eaf72 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:15.566786 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bfab9-d341-4131-97e7-337d7449fa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:15.567453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bfab9-d341-4131-97e7-337d7449fa5b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:15.567699 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bfab9-d341-4131-97e7-337d7449fa5b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:15.567965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bfab9-d341-4131-97e7-337d7449fa5b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:15.568600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bfab9-d341-4131-97e7-337d7449fa5b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:15.569976 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8bfab9-d341-4131-97e7-337d7449fa5b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-1b8bfab9-d341-4131-97e7-337d7449fa5b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:15.580254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:15.587111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:15.587978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 501/997] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:11:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:15.590393 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f385aca-b273-417e-ba4d-04295a80f2e0 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:15.648374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:15.701432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f385aca-b273-417e-ba4d-04295a80f2e0 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:15.745846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f2349-9c24-4503-a558-4bd9415849b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:15.746519 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f2349-9c24-4503-a558-4bd9415849b4 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:15.746806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f2349-9c24-4503-a558-4bd9415849b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:15.747086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f2349-9c24-4503-a558-4bd9415849b4 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:15.748323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f2349-9c24-4503-a558-4bd9415849b4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:15.748632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f2349-9c24-4503-a558-4bd9415849b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:15.750044 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f2349-9c24-4503-a558-4bd9415849b4 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:15.760222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 497/998] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:11:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:15.761881 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bfab9-d341-4131-97e7-337d7449fa5b None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:15.875755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bfab9-d341-4131-97e7-337d7449fa5b None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:15.889750 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:15.915094 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1594f3-f4c5-469c-8133-c5356bd023a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:15.915747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1594f3-f4c5-469c-8133-c5356bd023a2 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:15.916057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1594f3-f4c5-469c-8133-c5356bd023a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:15.916377 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1594f3-f4c5-469c-8133-c5356bd023a2 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:15.917076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1594f3-f4c5-469c-8133-c5356bd023a2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:15.917383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1594f3-f4c5-469c-8133-c5356bd023a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:15.918862 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1594f3-f4c5-469c-8133-c5356bd023a2 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:15.930102 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 502/999] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:11:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:15.931759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f2349-9c24-4503-a558-4bd9415849b4 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:16.051620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f2349-9c24-4503-a558-4bd9415849b4 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:16.070024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:16.089411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3b32a-3010-45e2-9e71-219b5e89ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:16.090061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b32a-3010-45e2-9e71-219b5e89ef20 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:16.090343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b32a-3010-45e2-9e71-219b5e89ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:16.090616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b32a-3010-45e2-9e71-219b5e89ef20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:16.091890 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3b32a-3010-45e2-9e71-219b5e89ef20 None admin] RBAC: Adding query filter params (interface=public, service_id=277e8d62dfe043c683419e8bf87ea7d6, region_id=RegionOne) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:16.092201 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3b32a-3010-45e2-9e71-219b5e89ef20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:16.093579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3b32a-3010-45e2-9e71-219b5e89ef20 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:16.099396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 498/1000] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 08:11:15 2022] GET /identity/v3/endpoints?service_id=277e8d62dfe043c683419e8bf87ea7d6&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:16.104696 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1594f3-f4c5-469c-8133-c5356bd023a2 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:16.189837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf60ee-de50-49f9-aec5-a4fd85861239 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:16.190090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf60ee-de50-49f9-aec5-a4fd85861239 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:16.190209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf60ee-de50-49f9-aec5-a4fd85861239 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:16.194062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 499/1001] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:16.197850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ead34-bda9-4b21-be52-a756ecd46f8e None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:16.198529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ead34-bda9-4b21-be52-a756ecd46f8e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:16.199017 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ead34-bda9-4b21-be52-a756ecd46f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:16.219305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1594f3-f4c5-469c-8133-c5356bd023a2 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:16.219812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-204ead34-bda9-4b21-be52-a756ecd46f8e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:16.221350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-204ead34-bda9-4b21-be52-a756ecd46f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:16.264854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b826e7-5e13-4a7d-a3af-853a5b529970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:16.265481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b826e7-5e13-4a7d-a3af-853a5b529970 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:16.265767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b826e7-5e13-4a7d-a3af-853a5b529970 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:16.266067 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b826e7-5e13-4a7d-a3af-853a5b529970 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:16.266732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b826e7-5e13-4a7d-a3af-853a5b529970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:16.268109 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b826e7-5e13-4a7d-a3af-853a5b529970 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:16.275550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 503/1002] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 08:11:16 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:11:16.320962 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 500/1003] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:16.345612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b826e7-5e13-4a7d-a3af-853a5b529970 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:16.406060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:16.503612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b826e7-5e13-4a7d-a3af-853a5b529970 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:16.544804 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9583d4-8386-4273-b67a-7d699176290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:16.545473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9583d4-8386-4273-b67a-7d699176290f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:16.545751 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9583d4-8386-4273-b67a-7d699176290f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:16.546056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9583d4-8386-4273-b67a-7d699176290f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:16.546720 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9583d4-8386-4273-b67a-7d699176290f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:16.548104 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9583d4-8386-4273-b67a-7d699176290f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-0a9583d4-8386-4273-b67a-7d699176290f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:16.558237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:16.559366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:16.560240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 504/1004] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 08:11:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:16.567527 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ead34-bda9-4b21-be52-a756ecd46f8e None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:16.691290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ead34-bda9-4b21-be52-a756ecd46f8e None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:16.706268 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:16.737351 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e4f4d-0553-487d-aea0-4a076e87e3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:16.738374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e4f4d-0553-487d-aea0-4a076e87e3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:16.738842 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e4f4d-0553-487d-aea0-4a076e87e3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:16.739308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e4f4d-0553-487d-aea0-4a076e87e3c0 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:16.740173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e4f4d-0553-487d-aea0-4a076e87e3c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:16.740635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e4f4d-0553-487d-aea0-4a076e87e3c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:16.742253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e4f4d-0553-487d-aea0-4a076e87e3c0 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:16.748673 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 501/1005] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 08:11:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:16.756980 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9583d4-8386-4273-b67a-7d699176290f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:16.881557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9583d4-8386-4273-b67a-7d699176290f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:16.884430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:16.920173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458dbf1-4941-436e-81f0-21781de490f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:16.920807 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458dbf1-4941-436e-81f0-21781de490f3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:16.921088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458dbf1-4941-436e-81f0-21781de490f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:16.921361 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458dbf1-4941-436e-81f0-21781de490f3 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:16.922092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458dbf1-4941-436e-81f0-21781de490f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:16.922402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458dbf1-4941-436e-81f0-21781de490f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:16.923773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458dbf1-4941-436e-81f0-21781de490f3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:16.934672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 505/1006] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 08:11:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:16.936345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e4f4d-0553-487d-aea0-4a076e87e3c0 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:17.069037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e4f4d-0553-487d-aea0-4a076e87e3c0 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:17.112861 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c084ee0-8f0f-47c7-b492-8b24219f0cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:17.113961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084ee0-8f0f-47c7-b492-8b24219f0cfe None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:17.114719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084ee0-8f0f-47c7-b492-8b24219f0cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:17.115248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084ee0-8f0f-47c7-b492-8b24219f0cfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:17.116307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c084ee0-8f0f-47c7-b492-8b24219f0cfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:17.117980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c084ee0-8f0f-47c7-b492-8b24219f0cfe None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:17.144764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 502/1007] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:11:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:11:17.339100 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4aac-d50d-4995-852f-4f9fc5b5f9ae None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:17.339622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4aac-d50d-4995-852f-4f9fc5b5f9ae None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:17.339905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f4aac-d50d-4995-852f-4f9fc5b5f9ae None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:17.341294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 506/1008] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:17.347065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094bfb0-1e93-4c83-afda-f07e6875fb0f None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:17.347367 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094bfb0-1e93-4c83-afda-f07e6875fb0f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:17.347674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094bfb0-1e93-4c83-afda-f07e6875fb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:17.367237 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-a094bfb0-1e93-4c83-afda-f07e6875fb0f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:17.368461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-a094bfb0-1e93-4c83-afda-f07e6875fb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:17.399738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:17.463323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 503/1009] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:17.484805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4aac-d50d-4995-852f-4f9fc5b5f9ae None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:17.598505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f4aac-d50d-4995-852f-4f9fc5b5f9ae None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:17.636209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb495ba-0ac4-4278-8b84-dcd4e3f0175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:17.636852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb495ba-0ac4-4278-8b84-dcd4e3f0175a None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:17.637137 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb495ba-0ac4-4278-8b84-dcd4e3f0175a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:17.637417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb495ba-0ac4-4278-8b84-dcd4e3f0175a None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:17.638195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb495ba-0ac4-4278-8b84-dcd4e3f0175a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:17.639561 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb495ba-0ac4-4278-8b84-dcd4e3f0175a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:17.662090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 507/1010] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:11:17 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:11:18.394347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d008b-8080-459a-9a70-573b68632a1e None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:18.394874 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d008b-8080-459a-9a70-573b68632a1e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:18.394874 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d008b-8080-459a-9a70-573b68632a1e None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:18.396277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 504/1011] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:18.401880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ce1aa-2c51-4d16-852a-6487364f5cd5 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:18.402354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ce1aa-2c51-4d16-852a-6487364f5cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:18.402454 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ce1aa-2c51-4d16-852a-6487364f5cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:18.421482 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-e50ce1aa-2c51-4d16-852a-6487364f5cd5 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:18.422735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e50ce1aa-2c51-4d16-852a-6487364f5cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:18.449509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:18.512753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 508/1012] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:18 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:18.536218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d008b-8080-459a-9a70-573b68632a1e None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:18.648144 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d008b-8080-459a-9a70-573b68632a1e None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:18.686339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0e55d-f4b1-449d-96f5-9c5e7beb2d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:18.687049 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0e55d-f4b1-449d-96f5-9c5e7beb2d66 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:18.687333 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0e55d-f4b1-449d-96f5-9c5e7beb2d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:18.687605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0e55d-f4b1-449d-96f5-9c5e7beb2d66 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:18.688244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0e55d-f4b1-449d-96f5-9c5e7beb2d66 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:18.689702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0e55d-f4b1-449d-96f5-9c5e7beb2d66 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-9dd0e55d-f4b1-449d-96f5-9c5e7beb2d66 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:18.702447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:18.704634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 08:11:18.707256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:18.714193 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 505/1013] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:11:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:18.714354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ce1aa-2c51-4d16-852a-6487364f5cd5 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:18.856331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ce1aa-2c51-4d16-852a-6487364f5cd5 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:18.914269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c661d4-1286-4fed-8da0-b0af89c3e0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:18.915216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c661d4-1286-4fed-8da0-b0af89c3e0bb None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:18.915628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c661d4-1286-4fed-8da0-b0af89c3e0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:18.915899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c661d4-1286-4fed-8da0-b0af89c3e0bb None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:18.916740 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c661d4-1286-4fed-8da0-b0af89c3e0bb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:18.917094 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c661d4-1286-4fed-8da0-b0af89c3e0bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:18.918486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c661d4-1286-4fed-8da0-b0af89c3e0bb None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:18.925148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 509/1014] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:11:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:18.931741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0e55d-f4b1-449d-96f5-9c5e7beb2d66 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:18.973775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:19.103023 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0e55d-f4b1-449d-96f5-9c5e7beb2d66 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:19.152992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7fe20-bbfa-40bc-b205-a4e00e133bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:19.152992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7fe20-bbfa-40bc-b205-a4e00e133bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:19.153317 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7fe20-bbfa-40bc-b205-a4e00e133bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:19.154337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7fe20-bbfa-40bc-b205-a4e00e133bc6 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:19.155116 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7fe20-bbfa-40bc-b205-a4e00e133bc6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:19.155430 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7fe20-bbfa-40bc-b205-a4e00e133bc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:19.156792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7fe20-bbfa-40bc-b205-a4e00e133bc6 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:19.168144 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 506/1015] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 08:11:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:19.170388 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c661d4-1286-4fed-8da0-b0af89c3e0bb None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:19.190687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:19.314860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c661d4-1286-4fed-8da0-b0af89c3e0bb None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:19.368802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fa79b-d665-4fe3-b7b0-86dd95e19258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:19.369432 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa79b-d665-4fe3-b7b0-86dd95e19258 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:19.369711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa79b-d665-4fe3-b7b0-86dd95e19258 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:19.369982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa79b-d665-4fe3-b7b0-86dd95e19258 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:19.370728 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fa79b-d665-4fe3-b7b0-86dd95e19258 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:19.372093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fa79b-d665-4fe3-b7b0-86dd95e19258 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:19.402045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 510/1016] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:11:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:11:19.695554 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0057d2-4e79-4a9b-abe1-211481c528b9 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:19.696092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0057d2-4e79-4a9b-abe1-211481c528b9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:19.696522 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0057d2-4e79-4a9b-abe1-211481c528b9 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:19.699403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 507/1017] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:19.708190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974bf00-e0e7-450e-ae5d-bfc0e379e655 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:19.708785 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974bf00-e0e7-450e-ae5d-bfc0e379e655 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:19.709286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974bf00-e0e7-450e-ae5d-bfc0e379e655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:19.738066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-1974bf00-e0e7-450e-ae5d-bfc0e379e655 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:19.739347 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-1974bf00-e0e7-450e-ae5d-bfc0e379e655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:19.815288 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:19.828365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 511/1018] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:19.847869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0057d2-4e79-4a9b-abe1-211481c528b9 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:19.860364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8c8a4-8221-4a6a-8393-bde4e7992067 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:19.860634 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8c8a4-8221-4a6a-8393-bde4e7992067 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:19.860821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d8c8a4-8221-4a6a-8393-bde4e7992067 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:19.862470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 512/1019] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:11:19.867886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e5488-1ad2-4b5d-9e94-3477e0cbe871 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:19.868249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e5488-1ad2-4b5d-9e94-3477e0cbe871 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:19.868477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e5488-1ad2-4b5d-9e94-3477e0cbe871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:19.892919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-152e5488-1ad2-4b5d-9e94-3477e0cbe871 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:19.894451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-152e5488-1ad2-4b5d-9e94-3477e0cbe871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:19.977190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:19.990200 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 513/1020] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:11:19.998734 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0057d2-4e79-4a9b-abe1-211481c528b9 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:20.010193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e5488-1ad2-4b5d-9e94-3477e0cbe871 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:20.052839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b8529-0498-4c19-b313-f17bf86c8084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:20.053815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b8529-0498-4c19-b313-f17bf86c8084 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:20.054290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b8529-0498-4c19-b313-f17bf86c8084 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:20.054716 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b8529-0498-4c19-b313-f17bf86c8084 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:20.056551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b8529-0498-4c19-b313-f17bf86c8084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:20.058910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b8529-0498-4c19-b313-f17bf86c8084 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:20.061643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 508/1021] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:20.069930 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b8529-0498-4c19-b313-f17bf86c8084 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:20.149995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e5488-1ad2-4b5d-9e94-3477e0cbe871 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:20.182166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:20.189126 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba2802-6995-4fdb-9a7a-6ab1a85b65c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:20.189783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba2802-6995-4fdb-9a7a-6ab1a85b65c3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:20.190113 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba2802-6995-4fdb-9a7a-6ab1a85b65c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:20.190376 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba2802-6995-4fdb-9a7a-6ab1a85b65c3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:20.191015 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba2802-6995-4fdb-9a7a-6ab1a85b65c3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:20.192398 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba2802-6995-4fdb-9a7a-6ab1a85b65c3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:20.202182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b8529-0498-4c19-b313-f17bf86c8084 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-aeba2802-6995-4fdb-9a7a-6ab1a85b65c3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:20.202483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:20.203476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:20.204367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 514/1022] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Aug 2 08:11:20 2022] GET /identity/v3/services/image => generated 86 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:20.209987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba2802-6995-4fdb-9a7a-6ab1a85b65c3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:20.250596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a03eec-700d-4fe1-b09c-e67a53f0766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:20.251106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a03eec-700d-4fe1-b09c-e67a53f0766c None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:20.251391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a03eec-700d-4fe1-b09c-e67a53f0766c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:20.251667 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a03eec-700d-4fe1-b09c-e67a53f0766c None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:20.252358 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a03eec-700d-4fe1-b09c-e67a53f0766c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:20.253800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a03eec-700d-4fe1-b09c-e67a53f0766c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:20.294043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 509/1023] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:11:20 2022] POST /identity/v3/projects => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:11:20.365681 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba2802-6995-4fdb-9a7a-6ab1a85b65c3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:20.407612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078394f6-f1dd-4c3a-9165-b39a44b045ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:20.408543 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078394f6-f1dd-4c3a-9165-b39a44b045ed None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:20.408825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078394f6-f1dd-4c3a-9165-b39a44b045ed None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:20.409107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078394f6-f1dd-4c3a-9165-b39a44b045ed None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:20.409824 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078394f6-f1dd-4c3a-9165-b39a44b045ed None admin] RBAC: Adding query filter params (name=image) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:20.410166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078394f6-f1dd-4c3a-9165-b39a44b045ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:20.411644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078394f6-f1dd-4c3a-9165-b39a44b045ed None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:20.423638 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 515/1024] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:20.425187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a03eec-700d-4fe1-b09c-e67a53f0766c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:20.437391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:20.551637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a03eec-700d-4fe1-b09c-e67a53f0766c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:20.588905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4233-9ab8-457f-acd6-a1203d830bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:20.589542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4233-9ab8-457f-acd6-a1203d830bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:20.589824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4233-9ab8-457f-acd6-a1203d830bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:20.590141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4233-9ab8-457f-acd6-a1203d830bd1 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:20.591508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec4233-9ab8-457f-acd6-a1203d830bd1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:20.591804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec4233-9ab8-457f-acd6-a1203d830bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:20.593252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec4233-9ab8-457f-acd6-a1203d830bd1 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:20.599107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 510/1025] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:20.605365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078394f6-f1dd-4c3a-9165-b39a44b045ed None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:20.680786 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:20.744921 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078394f6-f1dd-4c3a-9165-b39a44b045ed None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:20.789696 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f836a3f-ef41-4c30-a267-beeff0a0b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:20.792770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f836a3f-ef41-4c30-a267-beeff0a0b86d None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:20.792770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f836a3f-ef41-4c30-a267-beeff0a0b86d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:20.792770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f836a3f-ef41-4c30-a267-beeff0a0b86d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:20.792770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f836a3f-ef41-4c30-a267-beeff0a0b86d None admin] RBAC: Adding query filter params (interface=public, service_id=8262f133b18047ab950279b151e07000, region_id=RegionOne) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:20.792770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f836a3f-ef41-4c30-a267-beeff0a0b86d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:20.794185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f836a3f-ef41-4c30-a267-beeff0a0b86d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:20.806355 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 516/1026] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 08:11:20 2022] GET /identity/v3/endpoints?service_id=8262f133b18047ab950279b151e07000&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:20.808696 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4233-9ab8-457f-acd6-a1203d830bd1 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:20.897509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:20.940617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4233-9ab8-457f-acd6-a1203d830bd1 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:20.993702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6606990-4fcc-4291-a5d9-c0b11336a8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:20.994741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6606990-4fcc-4291-a5d9-c0b11336a8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:20.995193 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6606990-4fcc-4291-a5d9-c0b11336a8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:20.995569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6606990-4fcc-4291-a5d9-c0b11336a8e0 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:20.996512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6606990-4fcc-4291-a5d9-c0b11336a8e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:20.998835 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6606990-4fcc-4291-a5d9-c0b11336a8e0 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:21.014113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 511/1027] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 08:11:20 2022] GET /identity/v3/services => generated 1957 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:11:21.907971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd7ea4-4b27-4154-bf6d-f862a71518a2 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:21.908509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd7ea4-4b27-4154-bf6d-f862a71518a2 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:21.908988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd7ea4-4b27-4154-bf6d-f862a71518a2 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:21.911675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 517/1028] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:21.918663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408ce0-6169-4eef-8424-0bf2d16a0205 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:21.919244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408ce0-6169-4eef-8424-0bf2d16a0205 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:21.920181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408ce0-6169-4eef-8424-0bf2d16a0205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:21.952643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-7f408ce0-6169-4eef-8424-0bf2d16a0205 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:21.954100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7f408ce0-6169-4eef-8424-0bf2d16a0205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:22.038280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 512/1029] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:22.061808 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd7ea4-4b27-4154-bf6d-f862a71518a2 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:22.192360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd7ea4-4b27-4154-bf6d-f862a71518a2 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:22.232942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:22.252366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a2e1a-9f4c-47b5-9ca4-c13772e160b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:22.253022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a2e1a-9f4c-47b5-9ca4-c13772e160b5 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:22.253314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a2e1a-9f4c-47b5-9ca4-c13772e160b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:22.253583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a2e1a-9f4c-47b5-9ca4-c13772e160b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:22.265569 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a2e1a-9f4c-47b5-9ca4-c13772e160b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-c12a2e1a-9f4c-47b5-9ca4-c13772e160b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:11:22.270598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:22.271637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:11:22.272670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:22.273988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 518/1030] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 08:11:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:22.278026 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f408ce0-6169-4eef-8424-0bf2d16a0205 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:22.373368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:22.425260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f408ce0-6169-4eef-8424-0bf2d16a0205 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:22.470670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2720e-16ee-482d-be42-b7fe6b5141a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:22.471231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2720e-16ee-482d-be42-b7fe6b5141a1 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:22.471510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2720e-16ee-482d-be42-b7fe6b5141a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:22.471789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2720e-16ee-482d-be42-b7fe6b5141a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:22.472526 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2720e-16ee-482d-be42-b7fe6b5141a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:22.472832 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2720e-16ee-482d-be42-b7fe6b5141a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:22.474252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2720e-16ee-482d-be42-b7fe6b5141a1 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:22.484091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 513/1031] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 08:11:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:22.489625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a2e1a-9f4c-47b5-9ca4-c13772e160b5 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:22.505298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03794579-2576-4260-b857-0bb8cffdd69c None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:22.505641 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03794579-2576-4260-b857-0bb8cffdd69c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:22.505861 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03794579-2576-4260-b857-0bb8cffdd69c None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:22.507368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 514/1032] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:22.516314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398afe5a-fe28-40a1-9703-4722badb42ba None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:22.516600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398afe5a-fe28-40a1-9703-4722badb42ba None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:22.516881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398afe5a-fe28-40a1-9703-4722badb42ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:22.535819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-398afe5a-fe28-40a1-9703-4722badb42ba None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:22.537050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-398afe5a-fe28-40a1-9703-4722badb42ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:22.623562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 515/1033] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:22.626026 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a2e1a-9f4c-47b5-9ca4-c13772e160b5 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:22.648162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398afe5a-fe28-40a1-9703-4722badb42ba None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:22.666461 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166a007-844c-42aa-b676-eb9a7839bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:22.667375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166a007-844c-42aa-b676-eb9a7839bee6 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:22.667829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166a007-844c-42aa-b676-eb9a7839bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:22.668241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166a007-844c-42aa-b676-eb9a7839bee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:22.680481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166a007-844c-42aa-b676-eb9a7839bee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:22.681927 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166a007-844c-42aa-b676-eb9a7839bee6 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-0166a007-844c-42aa-b676-eb9a7839bee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:22.697131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:22.703322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:22.704290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:22.704290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:22.704290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:22.704290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:22.704290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 519/1034] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:22.704290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166a007-844c-42aa-b676-eb9a7839bee6 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:22.728603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:22.745224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:22.776850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398afe5a-fe28-40a1-9703-4722badb42ba None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:22.816163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f62d0-7cab-4308-ac8a-08e7e03bc5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:22.816929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f62d0-7cab-4308-ac8a-08e7e03bc5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:22.817247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f62d0-7cab-4308-ac8a-08e7e03bc5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:22.817387 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f62d0-7cab-4308-ac8a-08e7e03bc5b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:22.817718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166a007-844c-42aa-b676-eb9a7839bee6 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:22.818626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f62d0-7cab-4308-ac8a-08e7e03bc5b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:22.820071 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f62d0-7cab-4308-ac8a-08e7e03bc5b2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:22.826782 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 516/1035] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:22.828168 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f62d0-7cab-4308-ac8a-08e7e03bc5b2 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:22.856222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7226f8-3a91-4679-be63-5af443c0d209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:22.857500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7226f8-3a91-4679-be63-5af443c0d209 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:22.857785 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7226f8-3a91-4679-be63-5af443c0d209 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:22.858082 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7226f8-3a91-4679-be63-5af443c0d209 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:22.858786 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7226f8-3a91-4679-be63-5af443c0d209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:22.859090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7226f8-3a91-4679-be63-5af443c0d209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:22.860464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7226f8-3a91-4679-be63-5af443c0d209 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:22.873007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 520/1036] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:22.878626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7226f8-3a91-4679-be63-5af443c0d209 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:22.936491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f62d0-7cab-4308-ac8a-08e7e03bc5b2 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:22.965284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:22.975841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaaaf7-545a-4e0a-a203-cccdf2ba11c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:22.976953 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaaaf7-545a-4e0a-a203-cccdf2ba11c9 None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:22.977240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaaaf7-545a-4e0a-a203-cccdf2ba11c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:22.977683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaaaaf7-545a-4e0a-a203-cccdf2ba11c9 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:22.978420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaaaaf7-545a-4e0a-a203-cccdf2ba11c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:22.979922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaaaaf7-545a-4e0a-a203-cccdf2ba11c9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:22.985123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:22.997393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7226f8-3a91-4679-be63-5af443c0d209 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:23.005203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 517/1037] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:11:22 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:11:23.039085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb005c7-7bf6-4977-be39-4202f50625c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:23.040016 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb005c7-7bf6-4977-be39-4202f50625c0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:23.040299 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb005c7-7bf6-4977-be39-4202f50625c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:23.040575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb005c7-7bf6-4977-be39-4202f50625c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:23.050144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb005c7-7bf6-4977-be39-4202f50625c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:23.051789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb005c7-7bf6-4977-be39-4202f50625c0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-bbb005c7-7bf6-4977-be39-4202f50625c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:11:23.065066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:23.066273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:23.067352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:23.067352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:23.067352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:11:23.067352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:11:23.067352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:11:23.067352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:11:23.067352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:11:23.067352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:11:23.067352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:11:23.067352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:23.071326 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 521/1038] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 08:11:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:23.072632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaaaf7-545a-4e0a-a203-cccdf2ba11c9 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:23.193899 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaaaaf7-545a-4e0a-a203-cccdf2ba11c9 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:23.232151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1689047-2710-4ae1-9c67-1c616cb2f4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:23.233016 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1689047-2710-4ae1-9c67-1c616cb2f4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:23.233296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1689047-2710-4ae1-9c67-1c616cb2f4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:23.233574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1689047-2710-4ae1-9c67-1c616cb2f4f3 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:23.234456 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1689047-2710-4ae1-9c67-1c616cb2f4f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:23.234757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1689047-2710-4ae1-9c67-1c616cb2f4f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:23.236216 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1689047-2710-4ae1-9c67-1c616cb2f4f3 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:23.256980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 518/1039] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 08:11:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:23.262764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb005c7-7bf6-4977-be39-4202f50625c0 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:23.377040 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb005c7-7bf6-4977-be39-4202f50625c0 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:23.416169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84f1dc-2e28-41ba-8bea-e1e4ac86358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:23.417086 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84f1dc-2e28-41ba-8bea-e1e4ac86358e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:23.417516 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84f1dc-2e28-41ba-8bea-e1e4ac86358e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:23.417938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84f1dc-2e28-41ba-8bea-e1e4ac86358e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:23.445723 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:23.503600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84f1dc-2e28-41ba-8bea-e1e4ac86358e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:23.504972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84f1dc-2e28-41ba-8bea-e1e4ac86358e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:23.623767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 522/1040] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:11:23 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:11:23.629545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1689047-2710-4ae1-9c67-1c616cb2f4f3 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:23.684064 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:23.750148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1689047-2710-4ae1-9c67-1c616cb2f4f3 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:23.789563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0d223-2a52-4080-83ea-f34196465f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:23.790440 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d223-2a52-4080-83ea-f34196465f1d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:23.790719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d223-2a52-4080-83ea-f34196465f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:23.790992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d223-2a52-4080-83ea-f34196465f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:23.812963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0d223-2a52-4080-83ea-f34196465f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:23.815348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0d223-2a52-4080-83ea-f34196465f1d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-83a0d223-2a52-4080-83ea-f34196465f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:23.839454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:23.840451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:23.841372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:23.841372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:23.841372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:23.841372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:23.848678 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 519/1041] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:23.850407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84f1dc-2e28-41ba-8bea-e1e4ac86358e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:23.890098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a713e2-ea26-4276-bd52-2ca765da2a24 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:23.890385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a713e2-ea26-4276-bd52-2ca765da2a24 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:23.890657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a713e2-ea26-4276-bd52-2ca765da2a24 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:23.892073 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 520/1042] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:11:23.898102 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707204b-085f-4f97-9277-d5632dac7cde None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:23.898381 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707204b-085f-4f97-9277-d5632dac7cde None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:23.898654 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707204b-085f-4f97-9277-d5632dac7cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:23.921704 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-f707204b-085f-4f97-9277-d5632dac7cde None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:23.923004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f707204b-085f-4f97-9277-d5632dac7cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:23.934537 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:23.985739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84f1dc-2e28-41ba-8bea-e1e4ac86358e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:24.025365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e5f17-80ea-4076-9476-c5d9dee92c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:24.025902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5f17-80ea-4076-9476-c5d9dee92c14 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:24.026215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5f17-80ea-4076-9476-c5d9dee92c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:24.026493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e5f17-80ea-4076-9476-c5d9dee92c14 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:24.027195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e5f17-80ea-4076-9476-c5d9dee92c14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:24.027512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e5f17-80ea-4076-9476-c5d9dee92c14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:24.028924 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e5f17-80ea-4076-9476-c5d9dee92c14 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:24.029635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 521/1043] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:24.042359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 523/1044] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:24.048462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707204b-085f-4f97-9277-d5632dac7cde None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:24.054285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e5f17-80ea-4076-9476-c5d9dee92c14 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:24.079869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:24.175489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e5f17-80ea-4076-9476-c5d9dee92c14 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:24.177161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707204b-085f-4f97-9277-d5632dac7cde None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:24.192140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:24.222399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bae4a-645e-4de7-b7e2-4addfc755eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:24.223229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bae4a-645e-4de7-b7e2-4addfc755eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:24.223551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bae4a-645e-4de7-b7e2-4addfc755eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:24.223836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bae4a-645e-4de7-b7e2-4addfc755eb1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:24.224497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bae4a-645e-4de7-b7e2-4addfc755eb1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:24.226065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec08d-f3c9-419a-9330-9e7ff0e81011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:24.226251 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4bae4a-645e-4de7-b7e2-4addfc755eb1 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:24.226750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec08d-f3c9-419a-9330-9e7ff0e81011 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:24.227032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec08d-f3c9-419a-9330-9e7ff0e81011 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:24.227305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec08d-f3c9-419a-9330-9e7ff0e81011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:24.236048 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dec08d-f3c9-419a-9330-9e7ff0e81011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-4f4bae4a-645e-4de7-b7e2-4addfc755eb1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:24.237182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:24.238222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 08:11:24.239399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:24.240140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dec08d-f3c9-419a-9330-9e7ff0e81011 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:24.240747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 524/1045] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Aug 2 08:11:24 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:24.245770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bae4a-645e-4de7-b7e2-4addfc755eb1 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-38dec08d-f3c9-419a-9330-9e7ff0e81011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:11:24.256483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:24.257459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:24.258528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:11:24.258528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:11:24.258528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:11:24.258528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:11:24.258528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:11:24.258528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:11:24.258528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:24.258528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:24.259595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 522/1046] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:11:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:24.265545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec08d-f3c9-419a-9330-9e7ff0e81011 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:24.379896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:24.382455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4bae4a-645e-4de7-b7e2-4addfc755eb1 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:24.406294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec08d-f3c9-419a-9330-9e7ff0e81011 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:24.431285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c649d-cd04-49a9-9912-27199386e048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:24.431923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c649d-cd04-49a9-9912-27199386e048 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:24.432203 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c649d-cd04-49a9-9912-27199386e048 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:24.432486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c649d-cd04-49a9-9912-27199386e048 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:24.433153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c649d-cd04-49a9-9912-27199386e048 None admin] RBAC: Adding query filter params (name=image) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:24.433454 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c649d-cd04-49a9-9912-27199386e048 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:24.434852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c649d-cd04-49a9-9912-27199386e048 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:24.440748 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 525/1047] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:24.446316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c649d-cd04-49a9-9912-27199386e048 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:24.447413 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadad6e4-03f3-4f68-a09d-5e536cf313b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:24.448169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad6e4-03f3-4f68-a09d-5e536cf313b8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:24.448458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad6e4-03f3-4f68-a09d-5e536cf313b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:24.448732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadad6e4-03f3-4f68-a09d-5e536cf313b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:24.449502 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadad6e4-03f3-4f68-a09d-5e536cf313b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:24.449811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadad6e4-03f3-4f68-a09d-5e536cf313b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:24.451332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadad6e4-03f3-4f68-a09d-5e536cf313b8 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:24.472396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 523/1048] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:11:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:24.475105 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadad6e4-03f3-4f68-a09d-5e536cf313b8 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:24.516704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:24.613337 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c649d-cd04-49a9-9912-27199386e048 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:24.618727 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadad6e4-03f3-4f68-a09d-5e536cf313b8 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:24.652253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aa86e-56c6-451b-aea3-76cb955ca5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:24.652885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa86e-56c6-451b-aea3-76cb955ca5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:24.653171 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa86e-56c6-451b-aea3-76cb955ca5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:24.653520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42aa86e-56c6-451b-aea3-76cb955ca5e2 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:24.654854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42aa86e-56c6-451b-aea3-76cb955ca5e2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:24.655165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42aa86e-56c6-451b-aea3-76cb955ca5e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:24.656677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42aa86e-56c6-451b-aea3-76cb955ca5e2 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:24.667749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 526/1049] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:24.667994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480ac20-7061-4dec-8856-c85d0fa519d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:24.667994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ac20-7061-4dec-8856-c85d0fa519d5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:24.667994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ac20-7061-4dec-8856-c85d0fa519d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:24.667994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480ac20-7061-4dec-8856-c85d0fa519d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:24.668538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ac20-7061-4dec-8856-c85d0fa519d5 None admin] RBAC: Adding query filter params (role.id=ffef296fbbfa4bdb94ad2fc75f4e92f2, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=93143507a8784a30bc6b4a5e1f24f0b6) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:24.668538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ac20-7061-4dec-8856-c85d0fa519d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:24.668538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480ac20-7061-4dec-8856-c85d0fa519d5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:24.670958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aa86e-56c6-451b-aea3-76cb955ca5e2 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:24.675276 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 524/1050] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:11:24 2022] GET /identity/v3/role_assignments?user.id=93143507a8784a30bc6b4a5e1f24f0b6&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=ffef296fbbfa4bdb94ad2fc75f4e92f2 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:24.801401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42aa86e-56c6-451b-aea3-76cb955ca5e2 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:24.809878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:24.846354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f129d-d02a-4a35-8a24-b8345a3fef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:24.846982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f129d-d02a-4a35-8a24-b8345a3fef6d None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:24.847262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f129d-d02a-4a35-8a24-b8345a3fef6d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:24.847534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f129d-d02a-4a35-8a24-b8345a3fef6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:24.848250 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f129d-d02a-4a35-8a24-b8345a3fef6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:24.849667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f129d-d02a-4a35-8a24-b8345a3fef6d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:24.873367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 527/1051] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:11:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:11:25.287955 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14efbe-8b9b-49d9-8878-da624dc9725c None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:25.288484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14efbe-8b9b-49d9-8878-da624dc9725c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:25.288895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14efbe-8b9b-49d9-8878-da624dc9725c None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:25.290882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 525/1052] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:25.299600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cda96-7708-4781-95f1-c26c47a5d2cb None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:25.300484 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cda96-7708-4781-95f1-c26c47a5d2cb None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:25.300484 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cda96-7708-4781-95f1-c26c47a5d2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:25.321991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-230cda96-7708-4781-95f1-c26c47a5d2cb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:25.323223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-230cda96-7708-4781-95f1-c26c47a5d2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:25.458229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 528/1053] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:11:25.490074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14efbe-8b9b-49d9-8878-da624dc9725c None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:25.503371 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:25.604686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14efbe-8b9b-49d9-8878-da624dc9725c None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:25.641822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3abf-9e38-4db0-b87b-c5550acd1ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:25.642494 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3abf-9e38-4db0-b87b-c5550acd1ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:25.642771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3abf-9e38-4db0-b87b-c5550acd1ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:25.643042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3abf-9e38-4db0-b87b-c5550acd1ea3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:25.654794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa3abf-9e38-4db0-b87b-c5550acd1ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-09fa3abf-9e38-4db0-b87b-c5550acd1ea3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:11:25.659735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:25.661006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:25.661853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:25.666307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 526/1054] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:11:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:25.667153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cda96-7708-4781-95f1-c26c47a5d2cb None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:25.757059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:25.772246 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cda96-7708-4781-95f1-c26c47a5d2cb None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:25.806329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d22d3-97da-47c4-bb9d-977810493298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:25.806952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d22d3-97da-47c4-bb9d-977810493298 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:25.807228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d22d3-97da-47c4-bb9d-977810493298 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:25.807558 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d22d3-97da-47c4-bb9d-977810493298 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:25.808302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d22d3-97da-47c4-bb9d-977810493298 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:25.808607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d22d3-97da-47c4-bb9d-977810493298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:25.810505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d22d3-97da-47c4-bb9d-977810493298 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:25.819955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 529/1055] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:11:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:25.826554 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3abf-9e38-4db0-b87b-c5550acd1ea3 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:25.898922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:25.936954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3abf-9e38-4db0-b87b-c5550acd1ea3 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:25.973687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a3d88-7a5a-41be-a16f-21b4c85bd886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:25.974488 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a3d88-7a5a-41be-a16f-21b4c85bd886 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:25.974787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a3d88-7a5a-41be-a16f-21b4c85bd886 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:25.975037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a3d88-7a5a-41be-a16f-21b4c85bd886 None admin] PATH_INFO: `/v3/users/ef38003f10f041f18a83d38ff2811608` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:25.989956 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a3d88-7a5a-41be-a16f-21b4c85bd886 None admin] RBAC: Authorizing `identity:get_user(user_id=ef38003f10f041f18a83d38ff2811608)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:25.991438 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a3d88-7a5a-41be-a16f-21b4c85bd886 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:25.998630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 527/1056] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:25 2022] GET /identity/v3/users/ef38003f10f041f18a83d38ff2811608 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:26.000037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d22d3-97da-47c4-bb9d-977810493298 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:26.111185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d22d3-97da-47c4-bb9d-977810493298 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:26.147450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee6b7e-941a-4504-b680-8894da7de2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:26.148084 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee6b7e-941a-4504-b680-8894da7de2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:26.148359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee6b7e-941a-4504-b680-8894da7de2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:26.148632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee6b7e-941a-4504-b680-8894da7de2a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:26.170111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:26.225588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee6b7e-941a-4504-b680-8894da7de2a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:26.227062 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee6b7e-941a-4504-b680-8894da7de2a7 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:26.364274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 530/1057] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:11:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:11:26.371144 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a3d88-7a5a-41be-a16f-21b4c85bd886 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:26.506165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a3d88-7a5a-41be-a16f-21b4c85bd886 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:26.544935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:26.558486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3139e517-d914-4fc6-985d-6a5b813dfe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:26.559137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e517-d914-4fc6-985d-6a5b813dfe27 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:26.559416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e517-d914-4fc6-985d-6a5b813dfe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:26.559683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3139e517-d914-4fc6-985d-6a5b813dfe27 None admin] PATH_INFO: `/v3/projects/89afaa040d8f49b69d1e3fe99ea44926` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:26.560913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139e517-d914-4fc6-985d-6a5b813dfe27 None admin] RBAC: Authorizing `identity:get_project(project_id=89afaa040d8f49b69d1e3fe99ea44926)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:26.562382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3139e517-d914-4fc6-985d-6a5b813dfe27 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:26.564240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 528/1058] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:11:26 2022] GET /identity/v3/projects/89afaa040d8f49b69d1e3fe99ea44926 => generated 311 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:26.570710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee6b7e-941a-4504-b680-8894da7de2a7 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:26.628870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:26.684663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee6b7e-941a-4504-b680-8894da7de2a7 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:26.719834 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f114ef-38d5-48b5-b66c-bad4a6140b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:26.720454 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f114ef-38d5-48b5-b66c-bad4a6140b6b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:26.720729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f114ef-38d5-48b5-b66c-bad4a6140b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:26.720995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f114ef-38d5-48b5-b66c-bad4a6140b6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:26.721781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f114ef-38d5-48b5-b66c-bad4a6140b6b None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=89afaa040d8f49b69d1e3fe99ea44926, user.id=ef38003f10f041f18a83d38ff2811608) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:26.722120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f114ef-38d5-48b5-b66c-bad4a6140b6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:26.723542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f114ef-38d5-48b5-b66c-bad4a6140b6b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:26.737228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 531/1059] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:11:26 2022] GET /identity/v3/role_assignments?user.id=ef38003f10f041f18a83d38ff2811608&scope.project.id=89afaa040d8f49b69d1e3fe99ea44926&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:26.809420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88377-1b2a-4f87-9928-411910e11e5a None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:26.809875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88377-1b2a-4f87-9928-411910e11e5a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:26.810424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88377-1b2a-4f87-9928-411910e11e5a None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:26.813162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 529/1060] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:26.819587 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2dc52-e5e6-4136-9504-8bc2994e6ace None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:26.819885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2dc52-e5e6-4136-9504-8bc2994e6ace None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:26.820175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2dc52-e5e6-4136-9504-8bc2994e6ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:26.842531 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-2bc2dc52-e5e6-4136-9504-8bc2994e6ace None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:26.844074 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2bc2dc52-e5e6-4136-9504-8bc2994e6ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:26.932726 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 532/1061] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:26.961551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88377-1b2a-4f87-9928-411910e11e5a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:27.151828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88377-1b2a-4f87-9928-411910e11e5a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:27.215900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88709209-6f23-4fb7-bdf7-1d561d5d47bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:27.216873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709209-6f23-4fb7-bdf7-1d561d5d47bb None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:27.217322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709209-6f23-4fb7-bdf7-1d561d5d47bb None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:27.217755 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88709209-6f23-4fb7-bdf7-1d561d5d47bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:27.221069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff68dc-b83f-4721-bd87-fee93623ecfc None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:27.221520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff68dc-b83f-4721-bd87-fee93623ecfc None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:27.221967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff68dc-b83f-4721-bd87-fee93623ecfc None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:27.224379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 533/1062] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:27.230336 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ff4ff-3622-47c5-ad07-a5aa61b32f30 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:27.230599 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ff4ff-3622-47c5-ad07-a5aa61b32f30 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:27.230884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ff4ff-3622-47c5-ad07-a5aa61b32f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:27.234196 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88709209-6f23-4fb7-bdf7-1d561d5d47bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-88709209-6f23-4fb7-bdf7-1d561d5d47bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:11:27.239385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:27.240390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:11:27.241257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:27.245814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 530/1063] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 08:11:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:27.246800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88709209-6f23-4fb7-bdf7-1d561d5d47bb None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:27.255023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-336ff4ff-3622-47c5-ad07-a5aa61b32f30 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:27.256627 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-336ff4ff-3622-47c5-ad07-a5aa61b32f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:27.308068 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:27.311748 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:27.342816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 534/1064] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:11:27.366365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ff4ff-3622-47c5-ad07-a5aa61b32f30 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:27.379858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88709209-6f23-4fb7-bdf7-1d561d5d47bb None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:27.418396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4bae1-9d20-4dad-9cc9-4ef3b32151ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:27.418948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4bae1-9d20-4dad-9cc9-4ef3b32151ad None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:27.419237 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4bae1-9d20-4dad-9cc9-4ef3b32151ad None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:27.419518 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4bae1-9d20-4dad-9cc9-4ef3b32151ad None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:27.420248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4bae1-9d20-4dad-9cc9-4ef3b32151ad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:27.420564 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4bae1-9d20-4dad-9cc9-4ef3b32151ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:27.421956 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4bae1-9d20-4dad-9cc9-4ef3b32151ad None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:27.431027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 531/1065] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 08:11:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:27.437335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4bae1-9d20-4dad-9cc9-4ef3b32151ad None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:27.487413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ff4ff-3622-47c5-ad07-a5aa61b32f30 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:27.531862 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753c7d-10af-46a8-b85c-6a44d87bf940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:27.532545 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753c7d-10af-46a8-b85c-6a44d87bf940 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:27.532825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753c7d-10af-46a8-b85c-6a44d87bf940 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:27.533096 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753c7d-10af-46a8-b85c-6a44d87bf940 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:27.564800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4bae1-9d20-4dad-9cc9-4ef3b32151ad None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:27.581408 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:27.583561 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:27.606993 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40f2ee-88dc-4d19-ba27-b71143cb6bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:27.607886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40f2ee-88dc-4d19-ba27-b71143cb6bbd None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:27.608309 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40f2ee-88dc-4d19-ba27-b71143cb6bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:27.608795 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40f2ee-88dc-4d19-ba27-b71143cb6bbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:27.611887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43753c7d-10af-46a8-b85c-6a44d87bf940 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:27.613671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43753c7d-10af-46a8-b85c-6a44d87bf940 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:27.621701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40f2ee-88dc-4d19-ba27-b71143cb6bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:27.623703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40f2ee-88dc-4d19-ba27-b71143cb6bbd None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-4b40f2ee-88dc-4d19-ba27-b71143cb6bbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:27.639603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:27.640601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:27.641537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:27.641537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:27.641537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:27.641537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:27.641537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 532/1066] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:27.646741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40f2ee-88dc-4d19-ba27-b71143cb6bbd None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:27.738177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 535/1067] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:11:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:11:27.740796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753c7d-10af-46a8-b85c-6a44d87bf940 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:27.759607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40f2ee-88dc-4d19-ba27-b71143cb6bbd None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:27.809755 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63077e0a-bb54-4614-b252-b9b7321d4ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:27.810786 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63077e0a-bb54-4614-b252-b9b7321d4ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:27.811355 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63077e0a-bb54-4614-b252-b9b7321d4ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:27.811899 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63077e0a-bb54-4614-b252-b9b7321d4ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:27.813007 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63077e0a-bb54-4614-b252-b9b7321d4ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:27.813737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63077e0a-bb54-4614-b252-b9b7321d4ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:27.815491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63077e0a-bb54-4614-b252-b9b7321d4ea8 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:27.834129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 533/1068] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:27.836211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:27.840167 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63077e0a-bb54-4614-b252-b9b7321d4ea8 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:27.873172 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753c7d-10af-46a8-b85c-6a44d87bf940 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:27.893819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:27.916294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a77fd-155d-4aab-b3fd-7a749d84ad09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:27.916715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a77fd-155d-4aab-b3fd-7a749d84ad09 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:27.916994 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a77fd-155d-4aab-b3fd-7a749d84ad09 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:27.917267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a77fd-155d-4aab-b3fd-7a749d84ad09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:27.941835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a77fd-155d-4aab-b3fd-7a749d84ad09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:27.943335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a77fd-155d-4aab-b3fd-7a749d84ad09 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-885a77fd-155d-4aab-b3fd-7a749d84ad09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:27.960576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:27.962362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:27.964219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:27.964219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:27.964219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:27.964219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:27.964219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 536/1069] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:27.967859 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a77fd-155d-4aab-b3fd-7a749d84ad09 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:28.003477 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63077e0a-bb54-4614-b252-b9b7321d4ea8 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:28.044519 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88cb71-fbd4-4bb8-a1de-e28bff504864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:28.045218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88cb71-fbd4-4bb8-a1de-e28bff504864 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:28.045507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88cb71-fbd4-4bb8-a1de-e28bff504864 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:28.045720 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88cb71-fbd4-4bb8-a1de-e28bff504864 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:28.054822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88cb71-fbd4-4bb8-a1de-e28bff504864 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:28.056282 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88cb71-fbd4-4bb8-a1de-e28bff504864 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-0e88cb71-fbd4-4bb8-a1de-e28bff504864 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:11:28.071086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:28.072180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:28.073166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:28.073166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:28.073166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:11:28.073166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:11:28.073166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:11:28.073166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:11:28.073166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:11:28.073166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:11:28.073166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:11:28.073166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:28.073166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 534/1070] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 08:11:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:28.079460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88cb71-fbd4-4bb8-a1de-e28bff504864 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:28.108496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a77fd-155d-4aab-b3fd-7a749d84ad09 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:28.141465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:28.151673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0934b5-f86a-46aa-9b8f-27579b80f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:28.152357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0934b5-f86a-46aa-9b8f-27579b80f69f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:28.152642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0934b5-f86a-46aa-9b8f-27579b80f69f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:28.152919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0934b5-f86a-46aa-9b8f-27579b80f69f None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:28.153657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0934b5-f86a-46aa-9b8f-27579b80f69f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:28.153967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0934b5-f86a-46aa-9b8f-27579b80f69f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:28.155379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0934b5-f86a-46aa-9b8f-27579b80f69f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:28.178044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 537/1071] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:28.194579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:28.216179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88cb71-fbd4-4bb8-a1de-e28bff504864 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:28.255342 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f524a6-d6b1-41ea-b91d-d1d4f30a1918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:28.255882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f524a6-d6b1-41ea-b91d-d1d4f30a1918 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:28.256163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f524a6-d6b1-41ea-b91d-d1d4f30a1918 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:28.256438 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f524a6-d6b1-41ea-b91d-d1d4f30a1918 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:28.257255 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f524a6-d6b1-41ea-b91d-d1d4f30a1918 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:28.257564 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f524a6-d6b1-41ea-b91d-d1d4f30a1918 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:28.259130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f524a6-d6b1-41ea-b91d-d1d4f30a1918 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:28.282341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 535/1072] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 08:11:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:28.289125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0934b5-f86a-46aa-9b8f-27579b80f69f None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:28.429387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0934b5-f86a-46aa-9b8f-27579b80f69f None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:28.474344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1703448-b41f-433d-8b98-3b50dfd2b410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:28.475317 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1703448-b41f-433d-8b98-3b50dfd2b410 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:28.475607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1703448-b41f-433d-8b98-3b50dfd2b410 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:28.475886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1703448-b41f-433d-8b98-3b50dfd2b410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:28.490311 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1703448-b41f-433d-8b98-3b50dfd2b410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:28.492011 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1703448-b41f-433d-8b98-3b50dfd2b410 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-e1703448-b41f-433d-8b98-3b50dfd2b410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:28.510146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:28.511810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:28.513221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:28.513221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:28.513221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:28.513221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:28.513221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 538/1073] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:28.522679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f524a6-d6b1-41ea-b91d-d1d4f30a1918 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:28.645706 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f524a6-d6b1-41ea-b91d-d1d4f30a1918 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:28.687251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7663aa3-1c1a-48b9-a7a5-3b9368eb8387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:28.687880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7663aa3-1c1a-48b9-a7a5-3b9368eb8387 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:28.688157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7663aa3-1c1a-48b9-a7a5-3b9368eb8387 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:28.688427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7663aa3-1c1a-48b9-a7a5-3b9368eb8387 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:28.689117 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7663aa3-1c1a-48b9-a7a5-3b9368eb8387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:28.689419 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7663aa3-1c1a-48b9-a7a5-3b9368eb8387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:28.690814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7663aa3-1c1a-48b9-a7a5-3b9368eb8387 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:28.705074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 536/1074] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:28.710988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1703448-b41f-433d-8b98-3b50dfd2b410 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:28.755290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:28.820017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1703448-b41f-433d-8b98-3b50dfd2b410 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:28.851321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff997a9-a375-4b7e-ad19-5e6b11d94840 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:28.851601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff997a9-a375-4b7e-ad19-5e6b11d94840 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:28.851875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff997a9-a375-4b7e-ad19-5e6b11d94840 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:28.853221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 537/1075] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:11:28.854655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc3a3a-d249-47b1-9078-5bbc8d20e985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:28.855301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3a3a-d249-47b1-9078-5bbc8d20e985 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:28.855580 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3a3a-d249-47b1-9078-5bbc8d20e985 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:28.855852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc3a3a-d249-47b1-9078-5bbc8d20e985 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:28.858535 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ba7e-a8f4-4b82-9c05-079d8a6012fc None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:28.858825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ba7e-a8f4-4b82-9c05-079d8a6012fc None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:28.859104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ba7e-a8f4-4b82-9c05-079d8a6012fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:28.863179 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc3a3a-d249-47b1-9078-5bbc8d20e985 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:28.864633 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc3a3a-d249-47b1-9078-5bbc8d20e985 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:28.866803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-34dc3a3a-d249-47b1-9078-5bbc8d20e985 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:11:28.877009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:28.878106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:28.879017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:11:28.879017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:11:28.879017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:11:28.879017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:11:28.879017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:11:28.879017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:11:28.879017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:28.879017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:28.879487 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-bab9ba7e-a8f4-4b82-9c05-079d8a6012fc None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:28.879566 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 539/1076] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:11:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:28.879644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bab9ba7e-a8f4-4b82-9c05-079d8a6012fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:28.884011 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc3a3a-d249-47b1-9078-5bbc8d20e985 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:28.947230 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 538/1077] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:11:28.972480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9ba7e-a8f4-4b82-9c05-079d8a6012fc None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:28.982233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:28.986181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc3a3a-d249-47b1-9078-5bbc8d20e985 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:29.021007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00e5c0-727a-41b8-b56c-049c55838fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:29.021642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00e5c0-727a-41b8-b56c-049c55838fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:29.021921 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00e5c0-727a-41b8-b56c-049c55838fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:29.022234 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00e5c0-727a-41b8-b56c-049c55838fc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:29.023050 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00e5c0-727a-41b8-b56c-049c55838fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:29.023364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00e5c0-727a-41b8-b56c-049c55838fc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:29.024789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00e5c0-727a-41b8-b56c-049c55838fc3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:29.037718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 540/1078] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:11:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:29.044741 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00e5c0-727a-41b8-b56c-049c55838fc3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:29.077033 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9ba7e-a8f4-4b82-9c05-079d8a6012fc None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:29.111674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b29b-9877-4900-a781-42f752b71bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:29.112323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b29b-9877-4900-a781-42f752b71bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:29.112604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b29b-9877-4900-a781-42f752b71bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:29.112881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b29b-9877-4900-a781-42f752b71bd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:29.114826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:29.125381 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6b29b-9877-4900-a781-42f752b71bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-57a6b29b-9877-4900-a781-42f752b71bd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:11:29.130338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:29.131425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:29.132285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 539/1079] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:29.137457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b29b-9877-4900-a781-42f752b71bd9 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:29.151456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00e5c0-727a-41b8-b56c-049c55838fc3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:29.190579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94f86a-1f94-4a8b-bcc7-a48308b8dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:29.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94f86a-1f94-4a8b-bcc7-a48308b8dd8d None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:29.191540 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94f86a-1f94-4a8b-bcc7-a48308b8dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:29.191811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b94f86a-1f94-4a8b-bcc7-a48308b8dd8d None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/93143507a8784a30bc6b4a5e1f24f0b6/roles/ffef296fbbfa4bdb94ad2fc75f4e92f2` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:29.194072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94f86a-1f94-4a8b-bcc7-a48308b8dd8d None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=93143507a8784a30bc6b4a5e1f24f0b6, role_id=ffef296fbbfa4bdb94ad2fc75f4e92f2)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:29.195540 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b94f86a-1f94-4a8b-bcc7-a48308b8dd8d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:29.209772 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 541/1080] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:11:29 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/93143507a8784a30bc6b4a5e1f24f0b6/roles/ffef296fbbfa4bdb94ad2fc75f4e92f2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:11:29.249269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b29b-9877-4900-a781-42f752b71bd9 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:29.288678 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7095b-fcf1-4463-b483-125052107368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:29.289321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7095b-fcf1-4463-b483-125052107368 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:29.289846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7095b-fcf1-4463-b483-125052107368 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:29.290160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7095b-fcf1-4463-b483-125052107368 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:29.290909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7095b-fcf1-4463-b483-125052107368 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:29.291219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7095b-fcf1-4463-b483-125052107368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:29.292699 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7095b-fcf1-4463-b483-125052107368 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:29.303377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 540/1081] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:11:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:29.310129 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94f86a-1f94-4a8b-bcc7-a48308b8dd8d None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:29.335162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:29.435420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b94f86a-1f94-4a8b-bcc7-a48308b8dd8d None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:29.469789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc174ab-e09c-470e-bb67-c3b9a78b5039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:29.470559 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc174ab-e09c-470e-bb67-c3b9a78b5039 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:29.470838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc174ab-e09c-470e-bb67-c3b9a78b5039 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:29.471109 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc174ab-e09c-470e-bb67-c3b9a78b5039 None admin] PATH_INFO: `/v3/users/ef38003f10f041f18a83d38ff2811608` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:29.472369 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc174ab-e09c-470e-bb67-c3b9a78b5039 None admin] RBAC: Authorizing `identity:get_user(user_id=ef38003f10f041f18a83d38ff2811608)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:29.473965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc174ab-e09c-470e-bb67-c3b9a78b5039 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:29.475635 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 542/1082] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:29 2022] GET /identity/v3/users/ef38003f10f041f18a83d38ff2811608 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:29.484931 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7095b-fcf1-4463-b483-125052107368 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:29.544491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:29.609600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7095b-fcf1-4463-b483-125052107368 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:29.644179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64dfdb-2a12-45c4-b40d-25b8ffc605e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:29.644634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64dfdb-2a12-45c4-b40d-25b8ffc605e7 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:29.644953 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64dfdb-2a12-45c4-b40d-25b8ffc605e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:29.645220 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64dfdb-2a12-45c4-b40d-25b8ffc605e7 None admin] PATH_INFO: `/v3/projects/89afaa040d8f49b69d1e3fe99ea44926` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:29.646478 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64dfdb-2a12-45c4-b40d-25b8ffc605e7 None admin] RBAC: Authorizing `identity:get_project(project_id=89afaa040d8f49b69d1e3fe99ea44926)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:29.647897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c64dfdb-2a12-45c4-b40d-25b8ffc605e7 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:29.649570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 541/1083] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:11:29 2022] GET /identity/v3/projects/89afaa040d8f49b69d1e3fe99ea44926 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:29.656204 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc174ab-e09c-470e-bb67-c3b9a78b5039 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:29.749167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:29.765358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc174ab-e09c-470e-bb67-c3b9a78b5039 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:29.802827 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0bbe1-50b3-47d1-ac74-314a1e488c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:29.803503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0bbe1-50b3-47d1-ac74-314a1e488c56 None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:29.803785 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0bbe1-50b3-47d1-ac74-314a1e488c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:29.804062 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0bbe1-50b3-47d1-ac74-314a1e488c56 None admin] PATH_INFO: `/v3/projects/89afaa040d8f49b69d1e3fe99ea44926/users/ef38003f10f041f18a83d38ff2811608/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:29.806036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0bbe1-50b3-47d1-ac74-314a1e488c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=89afaa040d8f49b69d1e3fe99ea44926, user_id=ef38003f10f041f18a83d38ff2811608, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:29.807465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0bbe1-50b3-47d1-ac74-314a1e488c56 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:29.820922 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 543/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:11:29 2022] PUT /identity/v3/projects/89afaa040d8f49b69d1e3fe99ea44926/users/ef38003f10f041f18a83d38ff2811608/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:11:31.220149 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32789a58-e4de-464b-8477-52da450fe79b None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:31.220731 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32789a58-e4de-464b-8477-52da450fe79b None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:31.220731 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32789a58-e4de-464b-8477-52da450fe79b None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:31.222396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 542/1085] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:31.228652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621aba-1cbf-448b-962c-49ef66e05274 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:31.229173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621aba-1cbf-448b-962c-49ef66e05274 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:31.229546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621aba-1cbf-448b-962c-49ef66e05274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:31.252428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6a621aba-1cbf-448b-962c-49ef66e05274 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:31.253645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6a621aba-1cbf-448b-962c-49ef66e05274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:31.322243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 544/1086] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:31.346488 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32789a58-e4de-464b-8477-52da450fe79b None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:31.453365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32789a58-e4de-464b-8477-52da450fe79b None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:31.478452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:31.489542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5200151-03ab-426d-8450-720336827efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:31.490218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5200151-03ab-426d-8450-720336827efa None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:31.490503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5200151-03ab-426d-8450-720336827efa None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:31.490778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5200151-03ab-426d-8450-720336827efa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:31.501884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5200151-03ab-426d-8450-720336827efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-b5200151-03ab-426d-8450-720336827efa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:11:31.507454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:31.508735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:31.509599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 543/1087] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 08:11:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:31.515703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621aba-1cbf-448b-962c-49ef66e05274 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:31.595367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:31.622245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621aba-1cbf-448b-962c-49ef66e05274 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:31.658795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a22f76-6b24-46b9-b2b0-0e6267e61256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:31.659415 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a22f76-6b24-46b9-b2b0-0e6267e61256 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:31.659693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a22f76-6b24-46b9-b2b0-0e6267e61256 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:31.659966 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a22f76-6b24-46b9-b2b0-0e6267e61256 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:31.660696 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a22f76-6b24-46b9-b2b0-0e6267e61256 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:31.660996 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a22f76-6b24-46b9-b2b0-0e6267e61256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:31.662453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a22f76-6b24-46b9-b2b0-0e6267e61256 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:31.671258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 545/1088] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 08:11:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:31.677450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5200151-03ab-426d-8450-720336827efa None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:31.787892 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5200151-03ab-426d-8450-720336827efa None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:31.828175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ef8a3-f487-4429-9ea8-f099b189a827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:31.828857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ef8a3-f487-4429-9ea8-f099b189a827 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:31.829140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ef8a3-f487-4429-9ea8-f099b189a827 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:31.829416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ef8a3-f487-4429-9ea8-f099b189a827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:31.838248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03515679-04c3-4db0-bb47-1bb82e1be280 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:31.838539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03515679-04c3-4db0-bb47-1bb82e1be280 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:31.838820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03515679-04c3-4db0-bb47-1bb82e1be280 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:31.840185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 546/1089] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:11:31.841850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ef8a3-f487-4429-9ea8-f099b189a827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:31.843401 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ef8a3-f487-4429-9ea8-f099b189a827 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:31.845160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8732c5-c99f-458a-a8e3-38b956eb78bf None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:31.845447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8732c5-c99f-458a-a8e3-38b956eb78bf None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:31.845722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8732c5-c99f-458a-a8e3-38b956eb78bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-314ef8a3-f487-4429-9ea8-f099b189a827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:31.859971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:31.861113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:31.862063 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:31.862063 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:31.862063 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:31.862063 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:31.862063 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 544/1090] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:31.863611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-4e8732c5-c99f-458a-a8e3-38b956eb78bf None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:31.864811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4e8732c5-c99f-458a-a8e3-38b956eb78bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:31.867089 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ef8a3-f487-4429-9ea8-f099b189a827 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:31.905510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:31.943706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 547/1091] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:11:31.972427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8732c5-c99f-458a-a8e3-38b956eb78bf None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:31.984077 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ef8a3-f487-4429-9ea8-f099b189a827 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:32.022337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291a04a-7558-4954-ae8a-77edde3f45f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:32.023238 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a04a-7558-4954-ae8a-77edde3f45f1 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:32.023577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a04a-7558-4954-ae8a-77edde3f45f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:32.023987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a04a-7558-4954-ae8a-77edde3f45f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:32.024804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291a04a-7558-4954-ae8a-77edde3f45f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:32.025175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291a04a-7558-4954-ae8a-77edde3f45f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:32.026940 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291a04a-7558-4954-ae8a-77edde3f45f1 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:32.040386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 545/1092] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:32.045275 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:32.046629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291a04a-7558-4954-ae8a-77edde3f45f1 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:32.082241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8732c5-c99f-458a-a8e3-38b956eb78bf None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:32.120080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c62d76-eaa9-48bf-a67b-22f180e239b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:32.120820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c62d76-eaa9-48bf-a67b-22f180e239b6 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:32.121090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c62d76-eaa9-48bf-a67b-22f180e239b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:32.121362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c62d76-eaa9-48bf-a67b-22f180e239b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:32.134267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c62d76-eaa9-48bf-a67b-22f180e239b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-a0c62d76-eaa9-48bf-a67b-22f180e239b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:11:32.139783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:32.141134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:32.142240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 548/1093] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:32.147800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c62d76-eaa9-48bf-a67b-22f180e239b6 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:32.156897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:32.164062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291a04a-7558-4954-ae8a-77edde3f45f1 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:32.206838 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4dbb8-4136-4b92-9201-d6fed0ced777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:32.207584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4dbb8-4136-4b92-9201-d6fed0ced777 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:32.207973 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4dbb8-4136-4b92-9201-d6fed0ced777 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:32.208252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4dbb8-4136-4b92-9201-d6fed0ced777 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:32.216582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4dbb8-4136-4b92-9201-d6fed0ced777 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:32.218113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4dbb8-4136-4b92-9201-d6fed0ced777 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-c9a4dbb8-4136-4b92-9201-d6fed0ced777 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:11:32.232595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:32.234251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:32.235225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:32.235225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:32.235225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:11:32.235225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:11:32.235225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:11:32.235225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:11:32.235225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:11:32.235225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:11:32.235225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 08:11:32.235225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:32.235225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 546/1094] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 08:11:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:32.240332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4dbb8-4136-4b92-9201-d6fed0ced777 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:32.265848 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c62d76-eaa9-48bf-a67b-22f180e239b6 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:32.294875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:32.304775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357c7b-a44f-4ff5-917d-33404c2f0b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:32.305405 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357c7b-a44f-4ff5-917d-33404c2f0b43 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:32.305697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357c7b-a44f-4ff5-917d-33404c2f0b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:32.305971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24357c7b-a44f-4ff5-917d-33404c2f0b43 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:32.306741 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24357c7b-a44f-4ff5-917d-33404c2f0b43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:32.307055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24357c7b-a44f-4ff5-917d-33404c2f0b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:32.308423 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24357c7b-a44f-4ff5-917d-33404c2f0b43 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:32.317782 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 549/1095] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:11:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:32.323909 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357c7b-a44f-4ff5-917d-33404c2f0b43 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:32.348507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4dbb8-4136-4b92-9201-d6fed0ced777 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:32.391985 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157cd28-f3f9-4fef-b424-172cc6888019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:32.392616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157cd28-f3f9-4fef-b424-172cc6888019 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:32.392898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157cd28-f3f9-4fef-b424-172cc6888019 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:32.393173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157cd28-f3f9-4fef-b424-172cc6888019 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:32.393988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157cd28-f3f9-4fef-b424-172cc6888019 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:32.394341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157cd28-f3f9-4fef-b424-172cc6888019 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:32.395806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157cd28-f3f9-4fef-b424-172cc6888019 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:32.421872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 547/1096] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 08:11:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:32.428736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157cd28-f3f9-4fef-b424-172cc6888019 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:32.446617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:32.447946 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24357c7b-a44f-4ff5-917d-33404c2f0b43 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:32.486277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d760679-164e-440c-892c-73f3f6d44b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:32.487018 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d760679-164e-440c-892c-73f3f6d44b2a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:32.487294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d760679-164e-440c-892c-73f3f6d44b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:32.487564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d760679-164e-440c-892c-73f3f6d44b2a None admin] PATH_INFO: `/v3/users/ef38003f10f041f18a83d38ff2811608` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:32.488777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d760679-164e-440c-892c-73f3f6d44b2a None admin] RBAC: Authorizing `identity:get_user(user_id=ef38003f10f041f18a83d38ff2811608)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:32.490222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d760679-164e-440c-892c-73f3f6d44b2a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:32.491850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 550/1097] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:32 2022] GET /identity/v3/users/ef38003f10f041f18a83d38ff2811608 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:32.498073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d760679-164e-440c-892c-73f3f6d44b2a None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:32.541318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157cd28-f3f9-4fef-b424-172cc6888019 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:32.560080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:32.581637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd0313-de8d-4204-b56e-70b7c3d165a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:32.582312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd0313-de8d-4204-b56e-70b7c3d165a4 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:32.582590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd0313-de8d-4204-b56e-70b7c3d165a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:32.582999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd0313-de8d-4204-b56e-70b7c3d165a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:32.605975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d760679-164e-440c-892c-73f3f6d44b2a None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:32.645440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd137bc-4767-4503-88de-b2b0bc4dc5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:32.646094 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd137bc-4767-4503-88de-b2b0bc4dc5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:32.646502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd137bc-4767-4503-88de-b2b0bc4dc5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:32.646722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd137bc-4767-4503-88de-b2b0bc4dc5c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:32.661229 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd0313-de8d-4204-b56e-70b7c3d165a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:32.663151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd0313-de8d-4204-b56e-70b7c3d165a4 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:32.683073 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:32.726083 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd137bc-4767-4503-88de-b2b0bc4dc5c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:32.728669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd137bc-4767-4503-88de-b2b0bc4dc5c6 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:32.785356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 548/1098] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:11:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:11:32.792027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd0313-de8d-4204-b56e-70b7c3d165a4 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:32.803623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:32.853000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 551/1099] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:11:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 08:11:32.859220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd137bc-4767-4503-88de-b2b0bc4dc5c6 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:32.924376 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd0313-de8d-4204-b56e-70b7c3d165a4 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:32.945739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:32.973660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b1f41-843c-412c-9823-016b57f8da60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:32.974487 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b1f41-843c-412c-9823-016b57f8da60 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:32.974779 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b1f41-843c-412c-9823-016b57f8da60 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:32.975056 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b1f41-843c-412c-9823-016b57f8da60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:32.987253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b1f41-843c-412c-9823-016b57f8da60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:32.990135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd137bc-4767-4503-88de-b2b0bc4dc5c6 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:32.990509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b1f41-843c-412c-9823-016b57f8da60 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-9e3b1f41-843c-412c-9823-016b57f8da60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:11:33.013034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:33.014157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:33.015106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:11:33.015106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:11:33.015106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:11:33.015106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:33.015708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 549/1100] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:33.020179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b1f41-843c-412c-9823-016b57f8da60 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:33.028886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e489-20fa-488c-9959-ba0d02631056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:33.029542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e489-20fa-488c-9959-ba0d02631056 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:33.029948 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e489-20fa-488c-9959-ba0d02631056 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:33.030246 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480e489-20fa-488c-9959-ba0d02631056 None admin] PATH_INFO: `/v3/projects/89afaa040d8f49b69d1e3fe99ea44926` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:33.031424 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480e489-20fa-488c-9959-ba0d02631056 None admin] RBAC: Authorizing `identity:get_project(project_id=89afaa040d8f49b69d1e3fe99ea44926)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:33.033098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480e489-20fa-488c-9959-ba0d02631056 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:33.034851 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 552/1101] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:11:32 2022] GET /identity/v3/projects/89afaa040d8f49b69d1e3fe99ea44926 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:33.041003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e489-20fa-488c-9959-ba0d02631056 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:33.072513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:33.135570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b1f41-843c-412c-9823-016b57f8da60 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:33.149587 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480e489-20fa-488c-9959-ba0d02631056 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:33.173197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586f9f-6410-4120-b758-e3600575f3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:33.173918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586f9f-6410-4120-b758-e3600575f3ba None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:33.174232 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586f9f-6410-4120-b758-e3600575f3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:33.174514 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8586f9f-6410-4120-b758-e3600575f3ba None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:33.175253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8586f9f-6410-4120-b758-e3600575f3ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:33.175777 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8586f9f-6410-4120-b758-e3600575f3ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:33.177134 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8586f9f-6410-4120-b758-e3600575f3ba None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:33.188324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d38aee-4670-4bd0-a3d9-dbddbded4199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:33.188954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38aee-4670-4bd0-a3d9-dbddbded4199 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:33.189232 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38aee-4670-4bd0-a3d9-dbddbded4199 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:33.189506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d38aee-4670-4bd0-a3d9-dbddbded4199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:33.190331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38aee-4670-4bd0-a3d9-dbddbded4199 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=89afaa040d8f49b69d1e3fe99ea44926, user.id=ef38003f10f041f18a83d38ff2811608) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:33.190642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38aee-4670-4bd0-a3d9-dbddbded4199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:33.191558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 550/1102] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:33.194640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d38aee-4670-4bd0-a3d9-dbddbded4199 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:33.197361 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586f9f-6410-4120-b758-e3600575f3ba None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:33.202221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 553/1103] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:11:33 2022] GET /identity/v3/role_assignments?user.id=ef38003f10f041f18a83d38ff2811608&scope.project.id=89afaa040d8f49b69d1e3fe99ea44926&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:33.230282 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:33.315939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8586f9f-6410-4120-b758-e3600575f3ba None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:33.360199 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa41fc7-7a1f-43eb-bd02-f39c1a682819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:33.360703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa41fc7-7a1f-43eb-bd02-f39c1a682819 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:33.360985 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa41fc7-7a1f-43eb-bd02-f39c1a682819 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:33.361261 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa41fc7-7a1f-43eb-bd02-f39c1a682819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:33.372792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa41fc7-7a1f-43eb-bd02-f39c1a682819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:33.374379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa41fc7-7a1f-43eb-bd02-f39c1a682819 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-caa41fc7-7a1f-43eb-bd02-f39c1a682819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:11:33.386764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:33.388352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:33.389269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:11:33.389269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:11:33.389269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:11:33.389269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:11:33.389269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:11:33.389269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:11:33.389269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:11:33.389269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:33.389269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 551/1104] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:11:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:11:33.396782 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d38aee-4670-4bd0-a3d9-dbddbded4199 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:33.499844 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:33.510431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d38aee-4670-4bd0-a3d9-dbddbded4199 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:33.550584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e23ee-ebd9-41e2-be30-85b4a011718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:33.551251 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e23ee-ebd9-41e2-be30-85b4a011718f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:33.551630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e23ee-ebd9-41e2-be30-85b4a011718f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:33.551908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e23ee-ebd9-41e2-be30-85b4a011718f None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:33.552706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e23ee-ebd9-41e2-be30-85b4a011718f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:33.553096 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e23ee-ebd9-41e2-be30-85b4a011718f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:33.554624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e23ee-ebd9-41e2-be30-85b4a011718f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:33.570534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 554/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:33.577077 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa41fc7-7a1f-43eb-bd02-f39c1a682819 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:33.681300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:33.702365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa41fc7-7a1f-43eb-bd02-f39c1a682819 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:33.738019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54a9ea-cc9e-4413-bc1d-044330a36406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:33.738675 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54a9ea-cc9e-4413-bc1d-044330a36406 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:33.738959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54a9ea-cc9e-4413-bc1d-044330a36406 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:33.739234 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54a9ea-cc9e-4413-bc1d-044330a36406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:33.740031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54a9ea-cc9e-4413-bc1d-044330a36406 None admin] RBAC: Adding query filter params (role.id=ffef296fbbfa4bdb94ad2fc75f4e92f2, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=93143507a8784a30bc6b4a5e1f24f0b6) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:33.740345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54a9ea-cc9e-4413-bc1d-044330a36406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:33.741794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54a9ea-cc9e-4413-bc1d-044330a36406 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:33.748469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 552/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:11:33 2022] GET /identity/v3/role_assignments?user.id=93143507a8784a30bc6b4a5e1f24f0b6&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=ffef296fbbfa4bdb94ad2fc75f4e92f2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:35.274238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7ddd-8ac2-4f4d-ba75-c00a12c046b4 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:35.274812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7ddd-8ac2-4f4d-ba75-c00a12c046b4 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:35.274812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd7ddd-8ac2-4f4d-ba75-c00a12c046b4 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:35.276157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 555/1107] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:35.281693 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220e45d-5a77-473a-9757-d251e93232e2 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:35.282195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220e45d-5a77-473a-9757-d251e93232e2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:35.282352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220e45d-5a77-473a-9757-d251e93232e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:35.301427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-a220e45d-5a77-473a-9757-d251e93232e2 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:35.302651 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-a220e45d-5a77-473a-9757-d251e93232e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:35.379980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 553/1108] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:35.404832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd7ddd-8ac2-4f4d-ba75-c00a12c046b4 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:35.509083 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd7ddd-8ac2-4f4d-ba75-c00a12c046b4 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:35.547061 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463f2e4-fe9f-48d5-9b73-309637917082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:35.547610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f2e4-fe9f-48d5-9b73-309637917082 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:35.547886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f2e4-fe9f-48d5-9b73-309637917082 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:35.548159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f2e4-fe9f-48d5-9b73-309637917082 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:35.549309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463f2e4-fe9f-48d5-9b73-309637917082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:35.550758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463f2e4-fe9f-48d5-9b73-309637917082 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:35.552361 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 556/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:35.558200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220e45d-5a77-473a-9757-d251e93232e2 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:35.649321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:35.670804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220e45d-5a77-473a-9757-d251e93232e2 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:35.704253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1d084-d6a1-43d2-924a-f3a1760b3b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:35.704871 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d084-d6a1-43d2-924a-f3a1760b3b8d None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:35.705153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d084-d6a1-43d2-924a-f3a1760b3b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:35.705434 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1d084-d6a1-43d2-924a-f3a1760b3b8d None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:35.706147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1d084-d6a1-43d2-924a-f3a1760b3b8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:35.707584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1d084-d6a1-43d2-924a-f3a1760b3b8d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:35.728584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 554/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:11:35 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:11:37.765345 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f59ca-0488-481e-9aa8-d5a7bdfc8548 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:37.765890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f59ca-0488-481e-9aa8-d5a7bdfc8548 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:37.765890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f59ca-0488-481e-9aa8-d5a7bdfc8548 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:37.767447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 557/1111] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:37.772639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c8e17-3856-4d89-a548-a1258a36ee49 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:37.773062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c8e17-3856-4d89-a548-a1258a36ee49 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:37.773197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c8e17-3856-4d89-a548-a1258a36ee49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:37.791464 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-f11c8e17-3856-4d89-a548-a1258a36ee49 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:37.792670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f11c8e17-3856-4d89-a548-a1258a36ee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:37.865644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 555/1112] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:37.891416 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f59ca-0488-481e-9aa8-d5a7bdfc8548 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:37.911937 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:38.003022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f59ca-0488-481e-9aa8-d5a7bdfc8548 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:38.038767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644cb8d-4e93-4715-87e5-7de2df110ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:38.039334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644cb8d-4e93-4715-87e5-7de2df110ccc None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:38.039868 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644cb8d-4e93-4715-87e5-7de2df110ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:38.040144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644cb8d-4e93-4715-87e5-7de2df110ccc None admin] PATH_INFO: `/v3/roles/e1f4e92f38534e1d80123b0beaa2be47` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:38.041665 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644cb8d-4e93-4715-87e5-7de2df110ccc None admin] RBAC: Authorizing `identity:get_role(role_id=e1f4e92f38534e1d80123b0beaa2be47)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:38.043203 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644cb8d-4e93-4715-87e5-7de2df110ccc None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:38.046381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 558/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:37 2022] GET /identity/v3/roles/e1f4e92f38534e1d80123b0beaa2be47 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:38.052431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c8e17-3856-4d89-a548-a1258a36ee49 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:38.126088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:38.165408 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c8e17-3856-4d89-a548-a1258a36ee49 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:38.200646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c92bc5-330f-426b-80fd-501b6b9d39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:38.201293 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c92bc5-330f-426b-80fd-501b6b9d39c2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:38.201570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c92bc5-330f-426b-80fd-501b6b9d39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:38.201842 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c92bc5-330f-426b-80fd-501b6b9d39c2 None admin] PATH_INFO: `/v3/users/680f5e152a124359878cbe146481dccc` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:38.215517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c92bc5-330f-426b-80fd-501b6b9d39c2 None admin] RBAC: Authorizing `identity:get_user(user_id=680f5e152a124359878cbe146481dccc)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:38.216975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c92bc5-330f-426b-80fd-501b6b9d39c2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:38.218739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 556/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:38 2022] GET /identity/v3/users/680f5e152a124359878cbe146481dccc => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:38.224758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644cb8d-4e93-4715-87e5-7de2df110ccc None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:38.312952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:38.328005 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644cb8d-4e93-4715-87e5-7de2df110ccc None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:38.364893 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e4c03-123e-4804-8e4f-da0bf0e92b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:38.365520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e4c03-123e-4804-8e4f-da0bf0e92b79 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:38.365798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e4c03-123e-4804-8e4f-da0bf0e92b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:38.366102 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e4c03-123e-4804-8e4f-da0bf0e92b79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:38.440661 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e4c03-123e-4804-8e4f-da0bf0e92b79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:38.442117 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e4c03-123e-4804-8e4f-da0bf0e92b79 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:38.530860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:38.549639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 559/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:11:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:11:38.556476 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c92bc5-330f-426b-80fd-501b6b9d39c2 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:38.653831 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c92bc5-330f-426b-80fd-501b6b9d39c2 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:38.677046 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:38.687572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2de073-ebf0-4bd3-aa0b-7a8cc00c5db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:38.688204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2de073-ebf0-4bd3-aa0b-7a8cc00c5db5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:38.688480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2de073-ebf0-4bd3-aa0b-7a8cc00c5db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:38.688752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2de073-ebf0-4bd3-aa0b-7a8cc00c5db5 None admin] PATH_INFO: `/v3/projects/89afaa040d8f49b69d1e3fe99ea44926` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:38.689888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2de073-ebf0-4bd3-aa0b-7a8cc00c5db5 None admin] RBAC: Authorizing `identity:get_project(project_id=89afaa040d8f49b69d1e3fe99ea44926)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:38.691344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2de073-ebf0-4bd3-aa0b-7a8cc00c5db5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:38.692989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 557/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:11:38 2022] GET /identity/v3/projects/89afaa040d8f49b69d1e3fe99ea44926 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:38.699386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e4c03-123e-4804-8e4f-da0bf0e92b79 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:38.800503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e4c03-123e-4804-8e4f-da0bf0e92b79 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:38.836589 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7d197-e983-4f41-8a2a-4de939b4182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:38.837221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d197-e983-4f41-8a2a-4de939b4182e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:38.837510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d197-e983-4f41-8a2a-4de939b4182e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:38.837781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d197-e983-4f41-8a2a-4de939b4182e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:38.838598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7d197-e983-4f41-8a2a-4de939b4182e None admin] RBAC: Adding query filter params (role.id=e1f4e92f38534e1d80123b0beaa2be47, scope.project.id=89afaa040d8f49b69d1e3fe99ea44926, user.id=680f5e152a124359878cbe146481dccc) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:38.838931 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7d197-e983-4f41-8a2a-4de939b4182e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:38.840374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7d197-e983-4f41-8a2a-4de939b4182e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:38.846598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 560/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:11:38 2022] GET /identity/v3/role_assignments?user.id=680f5e152a124359878cbe146481dccc&scope.project.id=89afaa040d8f49b69d1e3fe99ea44926&role.id=e1f4e92f38534e1d80123b0beaa2be47 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:40.884200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d03204-c240-49b1-844e-2642edaf6c94 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:40.884739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d03204-c240-49b1-844e-2642edaf6c94 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:40.884739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d03204-c240-49b1-844e-2642edaf6c94 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:40.886125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 558/1118] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:40.892079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57a60f-1be5-4fb8-a174-bb2159c1b206 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:40.892530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57a60f-1be5-4fb8-a174-bb2159c1b206 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:40.892657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57a60f-1be5-4fb8-a174-bb2159c1b206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:40.911737 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6f57a60f-1be5-4fb8-a174-bb2159c1b206 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:40.913009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6f57a60f-1be5-4fb8-a174-bb2159c1b206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:40.966282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:40.986667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 561/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:41.010470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d03204-c240-49b1-844e-2642edaf6c94 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:41.122617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d03204-c240-49b1-844e-2642edaf6c94 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:41.160787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc62a4-b361-4fbc-b50f-d9503d6730cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:41.161342 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc62a4-b361-4fbc-b50f-d9503d6730cb None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:41.161624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc62a4-b361-4fbc-b50f-d9503d6730cb None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:41.161901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc62a4-b361-4fbc-b50f-d9503d6730cb None admin] PATH_INFO: `/v3/roles/e1f4e92f38534e1d80123b0beaa2be47` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:41.163635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc62a4-b361-4fbc-b50f-d9503d6730cb None admin] RBAC: Authorizing `identity:get_role(role_id=e1f4e92f38534e1d80123b0beaa2be47)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:41.165297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc62a4-b361-4fbc-b50f-d9503d6730cb None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:41.166709 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 559/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:41 2022] GET /identity/v3/roles/e1f4e92f38534e1d80123b0beaa2be47 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:41.172981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57a60f-1be5-4fb8-a174-bb2159c1b206 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:41.278892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57a60f-1be5-4fb8-a174-bb2159c1b206 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:41.315319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7cd42-6be5-45d0-a2fd-309964e68965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:41.316218 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cd42-6be5-45d0-a2fd-309964e68965 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:41.316600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cd42-6be5-45d0-a2fd-309964e68965 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:41.317052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7cd42-6be5-45d0-a2fd-309964e68965 None admin] PATH_INFO: `/v3/users/680f5e152a124359878cbe146481dccc` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:41.318696 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7cd42-6be5-45d0-a2fd-309964e68965 None admin] RBAC: Authorizing `identity:get_user(user_id=680f5e152a124359878cbe146481dccc)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:41.320428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7cd42-6be5-45d0-a2fd-309964e68965 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:41.322315 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 562/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:41 2022] GET /identity/v3/users/680f5e152a124359878cbe146481dccc => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:41.328235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc62a4-b361-4fbc-b50f-d9503d6730cb None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:41.399917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:41.442510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc62a4-b361-4fbc-b50f-d9503d6730cb None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:41.479593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e375577-7c21-4f3e-bcad-cffadae8d563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:41.480230 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e375577-7c21-4f3e-bcad-cffadae8d563 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:41.480509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e375577-7c21-4f3e-bcad-cffadae8d563 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:41.480780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e375577-7c21-4f3e-bcad-cffadae8d563 None admin] PATH_INFO: `/v3/projects/89afaa040d8f49b69d1e3fe99ea44926` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:41.482980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e375577-7c21-4f3e-bcad-cffadae8d563 None admin] RBAC: Authorizing `identity:get_project(project_id=89afaa040d8f49b69d1e3fe99ea44926)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:41.484605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e375577-7c21-4f3e-bcad-cffadae8d563 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:41.486556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 560/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:11:41 2022] GET /identity/v3/projects/89afaa040d8f49b69d1e3fe99ea44926 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:41.492960 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7cd42-6be5-45d0-a2fd-309964e68965 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:41.546399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:41.601617 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7cd42-6be5-45d0-a2fd-309964e68965 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:41.647221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143cd72-53ee-49dc-926a-680422e857ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:41.647901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143cd72-53ee-49dc-926a-680422e857ab None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:41.648182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143cd72-53ee-49dc-926a-680422e857ab None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:41.648468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143cd72-53ee-49dc-926a-680422e857ab None admin] PATH_INFO: `/v3/projects/89afaa040d8f49b69d1e3fe99ea44926/users/680f5e152a124359878cbe146481dccc/roles/e1f4e92f38534e1d80123b0beaa2be47` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:41.650702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143cd72-53ee-49dc-926a-680422e857ab None admin] RBAC: Authorizing `identity:create_grant(project_id=89afaa040d8f49b69d1e3fe99ea44926, user_id=680f5e152a124359878cbe146481dccc, role_id=e1f4e92f38534e1d80123b0beaa2be47)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:41.652157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143cd72-53ee-49dc-926a-680422e857ab None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:41.665556 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 563/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:11:41 2022] PUT /identity/v3/projects/89afaa040d8f49b69d1e3fe99ea44926/users/680f5e152a124359878cbe146481dccc/roles/e1f4e92f38534e1d80123b0beaa2be47 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:11:43.727609 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17191d-20b2-4416-b17a-b6f85aca1f06 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:43.728216 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17191d-20b2-4416-b17a-b6f85aca1f06 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:43.728216 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17191d-20b2-4416-b17a-b6f85aca1f06 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:43.729529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 561/1124] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:43.736178 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7801b1-e4d8-4264-8f96-299c85a9b2f3 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:43.736697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7801b1-e4d8-4264-8f96-299c85a9b2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:43.736697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7801b1-e4d8-4264-8f96-299c85a9b2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:43.755610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-fb7801b1-e4d8-4264-8f96-299c85a9b2f3 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:43.756835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-fb7801b1-e4d8-4264-8f96-299c85a9b2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:43.830844 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 564/1125] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:11:43.863553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17191d-20b2-4416-b17a-b6f85aca1f06 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:43.997870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17191d-20b2-4416-b17a-b6f85aca1f06 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:44.029390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:44.038457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030ca85-45e9-42f2-9fdf-2672d90e9fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:44.039114 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030ca85-45e9-42f2-9fdf-2672d90e9fba None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:44.039650 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030ca85-45e9-42f2-9fdf-2672d90e9fba None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:44.039925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030ca85-45e9-42f2-9fdf-2672d90e9fba None admin] PATH_INFO: `/v3/roles/e1f4e92f38534e1d80123b0beaa2be47` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:44.041385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030ca85-45e9-42f2-9fdf-2672d90e9fba None admin] RBAC: Authorizing `identity:get_role(role_id=e1f4e92f38534e1d80123b0beaa2be47)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:44.042791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030ca85-45e9-42f2-9fdf-2672d90e9fba None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:44.044780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 562/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:43 2022] GET /identity/v3/roles/e1f4e92f38534e1d80123b0beaa2be47 => generated 223 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:44.050629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7801b1-e4d8-4264-8f96-299c85a9b2f3 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:44.097782 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:44.170168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7801b1-e4d8-4264-8f96-299c85a9b2f3 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:44.207690 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc57ac-26ea-4833-98ee-155ab5080e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:44.208340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc57ac-26ea-4833-98ee-155ab5080e6c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:44.208620 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc57ac-26ea-4833-98ee-155ab5080e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:44.208906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc57ac-26ea-4833-98ee-155ab5080e6c None admin] PATH_INFO: `/v3/users/680f5e152a124359878cbe146481dccc` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:44.210146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc57ac-26ea-4833-98ee-155ab5080e6c None admin] RBAC: Authorizing `identity:get_user(user_id=680f5e152a124359878cbe146481dccc)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:44.211628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc57ac-26ea-4833-98ee-155ab5080e6c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:44.213340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 565/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:44 2022] GET /identity/v3/users/680f5e152a124359878cbe146481dccc => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:44.220680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030ca85-45e9-42f2-9fdf-2672d90e9fba None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:44.332906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030ca85-45e9-42f2-9fdf-2672d90e9fba None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:44.371801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422921a-7d92-402b-8542-af8c3bd7bc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:44.372375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422921a-7d92-402b-8542-af8c3bd7bc42 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:44.372661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422921a-7d92-402b-8542-af8c3bd7bc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:44.372940 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422921a-7d92-402b-8542-af8c3bd7bc42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:44.444903 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:44.453066 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422921a-7d92-402b-8542-af8c3bd7bc42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:44.454578 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422921a-7d92-402b-8542-af8c3bd7bc42 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:44.579365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 563/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:11:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:11:44.585859 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc57ac-26ea-4833-98ee-155ab5080e6c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:44.701018 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc57ac-26ea-4833-98ee-155ab5080e6c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:44.710852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:44.743834 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b46b77-e935-42b9-aa87-7e020536248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:44.744806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b46b77-e935-42b9-aa87-7e020536248f None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:44.745239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b46b77-e935-42b9-aa87-7e020536248f None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:44.745653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b46b77-e935-42b9-aa87-7e020536248f None admin] PATH_INFO: `/v3/projects/89afaa040d8f49b69d1e3fe99ea44926` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:44.747872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b46b77-e935-42b9-aa87-7e020536248f None admin] RBAC: Authorizing `identity:get_project(project_id=89afaa040d8f49b69d1e3fe99ea44926)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:44.750172 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b46b77-e935-42b9-aa87-7e020536248f None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:44.752749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 566/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:11:44 2022] GET /identity/v3/projects/89afaa040d8f49b69d1e3fe99ea44926 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:44.760691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422921a-7d92-402b-8542-af8c3bd7bc42 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:44.873000 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:44.882668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422921a-7d92-402b-8542-af8c3bd7bc42 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:44.927451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3eb8c-8571-4e38-8c63-88e9355bb3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:44.928076 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3eb8c-8571-4e38-8c63-88e9355bb3ac None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:44.928356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3eb8c-8571-4e38-8c63-88e9355bb3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:44.928635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3eb8c-8571-4e38-8c63-88e9355bb3ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:44.929432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3eb8c-8571-4e38-8c63-88e9355bb3ac None admin] RBAC: Adding query filter params (role.id=e1f4e92f38534e1d80123b0beaa2be47, scope.project.id=89afaa040d8f49b69d1e3fe99ea44926, user.id=680f5e152a124359878cbe146481dccc) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:44.929750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3eb8c-8571-4e38-8c63-88e9355bb3ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:44.931354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3eb8c-8571-4e38-8c63-88e9355bb3ac None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:44.939375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 564/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:11:44 2022] GET /identity/v3/role_assignments?user.id=680f5e152a124359878cbe146481dccc&scope.project.id=89afaa040d8f49b69d1e3fe99ea44926&role.id=e1f4e92f38534e1d80123b0beaa2be47 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:47.062284 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9f60-0680-418a-8a0b-a92899e34dae None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:47.062877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9f60-0680-418a-8a0b-a92899e34dae None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:47.062877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9f60-0680-418a-8a0b-a92899e34dae None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:47.064701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 567/1131] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:11:47.071062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70346e9a-b501-47ee-a56f-5c9f3c1b59a9 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:47.071587 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70346e9a-b501-47ee-a56f-5c9f3c1b59a9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:47.071587 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70346e9a-b501-47ee-a56f-5c9f3c1b59a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:47.091420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-70346e9a-b501-47ee-a56f-5c9f3c1b59a9 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:47.092599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-70346e9a-b501-47ee-a56f-5c9f3c1b59a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:47.173406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 565/1132] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:47.196945 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b9f60-0680-418a-8a0b-a92899e34dae None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:47.307791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b9f60-0680-418a-8a0b-a92899e34dae None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:47.344642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02f072-2204-4edc-8f0f-1019bd21f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:47.345196 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f072-2204-4edc-8f0f-1019bd21f6ba None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:47.345475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f072-2204-4edc-8f0f-1019bd21f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:47.345739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02f072-2204-4edc-8f0f-1019bd21f6ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:47.346973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02f072-2204-4edc-8f0f-1019bd21f6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:47.348404 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02f072-2204-4edc-8f0f-1019bd21f6ba None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:47.350085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 568/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:47.356151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70346e9a-b501-47ee-a56f-5c9f3c1b59a9 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:47.458298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:47.469034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70346e9a-b501-47ee-a56f-5c9f3c1b59a9 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:47.508403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5ce15-eec4-4b38-9bb9-423ab27fdad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:47.509028 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ce15-eec4-4b38-9bb9-423ab27fdad5 None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:47.509313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ce15-eec4-4b38-9bb9-423ab27fdad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:47.509588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ce15-eec4-4b38-9bb9-423ab27fdad5 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:47.510305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5ce15-eec4-4b38-9bb9-423ab27fdad5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:47.511737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5ce15-eec4-4b38-9bb9-423ab27fdad5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:47.540326 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 566/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:11:47 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:11:49.672224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cc055-aac4-495a-b6cb-7cdaab68b96d None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:49.672739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cc055-aac4-495a-b6cb-7cdaab68b96d None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:49.672739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cc055-aac4-495a-b6cb-7cdaab68b96d None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:49.674054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 569/1135] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:49.679718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded0de2-0ade-4c57-9172-55df306f8a0b None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:49.680221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded0de2-0ade-4c57-9172-55df306f8a0b None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:49.680314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded0de2-0ade-4c57-9172-55df306f8a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:49.703535 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-3ded0de2-0ade-4c57-9172-55df306f8a0b None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:49.704777 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3ded0de2-0ade-4c57-9172-55df306f8a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:49.788314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 567/1136] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:49.813840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cc055-aac4-495a-b6cb-7cdaab68b96d None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:49.870564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:49.932343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cc055-aac4-495a-b6cb-7cdaab68b96d None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:49.972134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f345e3b-1bae-436a-b916-6192c554766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:49.972793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f345e3b-1bae-436a-b916-6192c554766a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:49.973202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f345e3b-1bae-436a-b916-6192c554766a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:49.973699 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f345e3b-1bae-436a-b916-6192c554766a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:49.975243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f345e3b-1bae-436a-b916-6192c554766a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:49.976743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f345e3b-1bae-436a-b916-6192c554766a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:49.978469 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 570/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:11:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:49.985082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded0de2-0ade-4c57-9172-55df306f8a0b None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:50.066922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:50.100288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded0de2-0ade-4c57-9172-55df306f8a0b None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:50.137970 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923dea8-c8ff-4d04-a35e-87583b150325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:50.138620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dea8-c8ff-4d04-a35e-87583b150325 None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:50.138900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dea8-c8ff-4d04-a35e-87583b150325 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:50.139169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923dea8-c8ff-4d04-a35e-87583b150325 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:50.139892 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923dea8-c8ff-4d04-a35e-87583b150325 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:50.141408 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923dea8-c8ff-4d04-a35e-87583b150325 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:50.166218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 568/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:11:49 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:11:52.274306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d905041-2436-402a-a8d4-2196eb0af49a None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:52.274852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d905041-2436-402a-a8d4-2196eb0af49a None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:52.274852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d905041-2436-402a-a8d4-2196eb0af49a None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:52.276192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 571/1139] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:52.281773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a3cca-9420-48c7-8822-778f959ecf17 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:52.282346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a3cca-9420-48c7-8822-778f959ecf17 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:52.282346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a3cca-9420-48c7-8822-778f959ecf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:52.302438 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-dd9a3cca-9420-48c7-8822-778f959ecf17 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:52.303666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-dd9a3cca-9420-48c7-8822-778f959ecf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:52.377595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 569/1140] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:52.401070 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d905041-2436-402a-a8d4-2196eb0af49a None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:52.514550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d905041-2436-402a-a8d4-2196eb0af49a None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:52.529968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:52.561193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d159a-b7f6-4c38-b983-ea9d4311b596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:52.562107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d159a-b7f6-4c38-b983-ea9d4311b596 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:52.562583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d159a-b7f6-4c38-b983-ea9d4311b596 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:52.562882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d159a-b7f6-4c38-b983-ea9d4311b596 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:52.573759 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d159a-b7f6-4c38-b983-ea9d4311b596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-202d159a-b7f6-4c38-b983-ea9d4311b596 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:11:52.578866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:52.580269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:52.581309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 572/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:11:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:52.589182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a3cca-9420-48c7-8822-778f959ecf17 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:52.678300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:52.733949 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a3cca-9420-48c7-8822-778f959ecf17 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:52.787139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd2ec-12d0-4e1f-9ce6-cc2c34eae994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:52.787683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd2ec-12d0-4e1f-9ce6-cc2c34eae994 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:52.787961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd2ec-12d0-4e1f-9ce6-cc2c34eae994 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:52.788231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd2ec-12d0-4e1f-9ce6-cc2c34eae994 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:52.788968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd2ec-12d0-4e1f-9ce6-cc2c34eae994 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:52.789530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd2ec-12d0-4e1f-9ce6-cc2c34eae994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:52.790998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd2ec-12d0-4e1f-9ce6-cc2c34eae994 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:52.800658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 570/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:11:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:52.806746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d159a-b7f6-4c38-b983-ea9d4311b596 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:52.916674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d159a-b7f6-4c38-b983-ea9d4311b596 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:52.953303 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bde5a8-9348-4205-8372-1cc255dc28db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:52.954088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bde5a8-9348-4205-8372-1cc255dc28db None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:52.954397 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bde5a8-9348-4205-8372-1cc255dc28db None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:52.954728 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bde5a8-9348-4205-8372-1cc255dc28db None admin] PATH_INFO: `/v3/users/277c92a382064e9ead25fed14a94e5f1` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:52.970379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bde5a8-9348-4205-8372-1cc255dc28db None admin] RBAC: Authorizing `identity:get_user(user_id=277c92a382064e9ead25fed14a94e5f1)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:52.971835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bde5a8-9348-4205-8372-1cc255dc28db None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:52.973664 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 573/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:52 2022] GET /identity/v3/users/277c92a382064e9ead25fed14a94e5f1 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:52.979913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd2ec-12d0-4e1f-9ce6-cc2c34eae994 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:53.086603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd2ec-12d0-4e1f-9ce6-cc2c34eae994 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:53.108532 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:53.123628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7d3b8-1e93-47b0-bd2a-c181b16e1249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:53.124250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d3b8-1e93-47b0-bd2a-c181b16e1249 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:53.124554 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d3b8-1e93-47b0-bd2a-c181b16e1249 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:53.124807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d3b8-1e93-47b0-bd2a-c181b16e1249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:53.201343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7d3b8-1e93-47b0-bd2a-c181b16e1249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:53.202812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7d3b8-1e93-47b0-bd2a-c181b16e1249 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:53.299436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 571/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:11:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:11:53.305382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bde5a8-9348-4205-8372-1cc255dc28db None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:53.332904 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:53.406280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bde5a8-9348-4205-8372-1cc255dc28db None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:53.440134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1609161-3c67-43a1-baba-cdd82b6b69da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:53.440794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609161-3c67-43a1-baba-cdd82b6b69da None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:53.441071 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609161-3c67-43a1-baba-cdd82b6b69da None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:53.441342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1609161-3c67-43a1-baba-cdd82b6b69da None admin] PATH_INFO: `/v3/projects/2006628d239b415580322da852343523` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:53.442493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1609161-3c67-43a1-baba-cdd82b6b69da None admin] RBAC: Authorizing `identity:get_project(project_id=2006628d239b415580322da852343523)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:53.443907 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1609161-3c67-43a1-baba-cdd82b6b69da None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:53.445560 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 574/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:11:53 2022] GET /identity/v3/projects/2006628d239b415580322da852343523 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:53.452297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7d3b8-1e93-47b0-bd2a-c181b16e1249 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:53.473066 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:53.549905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7d3b8-1e93-47b0-bd2a-c181b16e1249 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:53.584101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63af5cf-2038-466b-a2b0-3cfc264d9870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:53.584706 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63af5cf-2038-466b-a2b0-3cfc264d9870 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:53.584981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63af5cf-2038-466b-a2b0-3cfc264d9870 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:53.585253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63af5cf-2038-466b-a2b0-3cfc264d9870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:53.586045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63af5cf-2038-466b-a2b0-3cfc264d9870 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=2006628d239b415580322da852343523, user.id=277c92a382064e9ead25fed14a94e5f1) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:53.586359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63af5cf-2038-466b-a2b0-3cfc264d9870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:53.587767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63af5cf-2038-466b-a2b0-3cfc264d9870 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:53.593145 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 572/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:11:53 2022] GET /identity/v3/role_assignments?user.id=277c92a382064e9ead25fed14a94e5f1&scope.project.id=2006628d239b415580322da852343523&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:11:55.564216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dcfd6-7d66-47c7-b83d-6ee75d505ea6 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:55.564771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dcfd6-7d66-47c7-b83d-6ee75d505ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:55.564771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dcfd6-7d66-47c7-b83d-6ee75d505ea6 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:55.566127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 575/1147] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:55.571382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cf2d-4264-4e48-92f7-6110b0c8f4d5 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:55.571802 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cf2d-4264-4e48-92f7-6110b0c8f4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:55.571923 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3cf2d-4264-4e48-92f7-6110b0c8f4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:55.590898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-3ee3cf2d-4264-4e48-92f7-6110b0c8f4d5 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:55.592092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3ee3cf2d-4264-4e48-92f7-6110b0c8f4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:55.658448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 573/1148] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:55.680385 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dcfd6-7d66-47c7-b83d-6ee75d505ea6 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:55.773714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:55.781149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dcfd6-7d66-47c7-b83d-6ee75d505ea6 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:55.815262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7465fc-88a2-43b6-8c2c-e612ce1b8f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:55.815897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7465fc-88a2-43b6-8c2c-e612ce1b8f77 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:55.816177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7465fc-88a2-43b6-8c2c-e612ce1b8f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:55.816447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7465fc-88a2-43b6-8c2c-e612ce1b8f77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:55.827091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7465fc-88a2-43b6-8c2c-e612ce1b8f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-4e7465fc-88a2-43b6-8c2c-e612ce1b8f77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:11:55.831914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:55.833132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:11:55.834230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 576/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:11:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:55.839979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3cf2d-4264-4e48-92f7-6110b0c8f4d5 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:55.854907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:55.950435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3cf2d-4264-4e48-92f7-6110b0c8f4d5 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:55.988173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20221177-fd32-4ea0-b276-b3ddd5e4e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:55.988791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20221177-fd32-4ea0-b276-b3ddd5e4e807 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:55.989070 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20221177-fd32-4ea0-b276-b3ddd5e4e807 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:55.989345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20221177-fd32-4ea0-b276-b3ddd5e4e807 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:55.990082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20221177-fd32-4ea0-b276-b3ddd5e4e807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:55.990387 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20221177-fd32-4ea0-b276-b3ddd5e4e807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:55.991756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20221177-fd32-4ea0-b276-b3ddd5e4e807 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:56.000439 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 574/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:11:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:56.006499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7465fc-88a2-43b6-8c2c-e612ce1b8f77 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:56.106347 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7465fc-88a2-43b6-8c2c-e612ce1b8f77 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:56.139846 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0f035-3f62-4e14-9e5d-48da19fb13c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:56.140502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0f035-3f62-4e14-9e5d-48da19fb13c3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:56.140766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0f035-3f62-4e14-9e5d-48da19fb13c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:56.141043 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0f035-3f62-4e14-9e5d-48da19fb13c3 None admin] PATH_INFO: `/v3/users/277c92a382064e9ead25fed14a94e5f1` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:56.142231 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0f035-3f62-4e14-9e5d-48da19fb13c3 None admin] RBAC: Authorizing `identity:get_user(user_id=277c92a382064e9ead25fed14a94e5f1)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:56.143645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0f035-3f62-4e14-9e5d-48da19fb13c3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:56.145253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 577/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:56 2022] GET /identity/v3/users/277c92a382064e9ead25fed14a94e5f1 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:56.151452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20221177-fd32-4ea0-b276-b3ddd5e4e807 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:56.228653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:56.252638 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20221177-fd32-4ea0-b276-b3ddd5e4e807 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:56.285838 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8da7e-50bf-46d6-bc63-60664b423c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:56.286493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8da7e-50bf-46d6-bc63-60664b423c03 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:56.286773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8da7e-50bf-46d6-bc63-60664b423c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:56.287070 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8da7e-50bf-46d6-bc63-60664b423c03 None admin] PATH_INFO: `/v3/projects/2006628d239b415580322da852343523` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:56.288221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8da7e-50bf-46d6-bc63-60664b423c03 None admin] RBAC: Authorizing `identity:get_project(project_id=2006628d239b415580322da852343523)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:56.289899 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8da7e-50bf-46d6-bc63-60664b423c03 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:56.291594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 575/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:11:56 2022] GET /identity/v3/projects/2006628d239b415580322da852343523 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:56.298310 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0f035-3f62-4e14-9e5d-48da19fb13c3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:56.323310 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:56.400788 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0f035-3f62-4e14-9e5d-48da19fb13c3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:56.435578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dde16-170b-429e-9e92-cc8e744d2dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:56.436247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dde16-170b-429e-9e92-cc8e744d2dfe None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:56.436523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dde16-170b-429e-9e92-cc8e744d2dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:56.436797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dde16-170b-429e-9e92-cc8e744d2dfe None admin] PATH_INFO: `/v3/projects/2006628d239b415580322da852343523/users/277c92a382064e9ead25fed14a94e5f1/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:56.438695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dde16-170b-429e-9e92-cc8e744d2dfe None admin] RBAC: Authorizing `identity:create_grant(project_id=2006628d239b415580322da852343523, user_id=277c92a382064e9ead25fed14a94e5f1, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:56.440092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dde16-170b-429e-9e92-cc8e744d2dfe None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:56.455790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 578/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:11:56 2022] PUT /identity/v3/projects/2006628d239b415580322da852343523/users/277c92a382064e9ead25fed14a94e5f1/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:11:58.417380 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e4288-1ef6-403c-aa35-d9a4f7a476a6 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:58.418456 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e4288-1ef6-403c-aa35-d9a4f7a476a6 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:58.418456 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e4288-1ef6-403c-aa35-d9a4f7a476a6 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:58.419825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 576/1154] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:11:58.425225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0098f-f4d7-4787-af18-932fa2258f31 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:58.425644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0098f-f4d7-4787-af18-932fa2258f31 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:58.425783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0098f-f4d7-4787-af18-932fa2258f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:58.444193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-4ce0098f-f4d7-4787-af18-932fa2258f31 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:11:58.445391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4ce0098f-f4d7-4787-af18-932fa2258f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:11:58.510725 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 579/1155] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:11:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:11:58.533701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e4288-1ef6-403c-aa35-d9a4f7a476a6 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:58.635406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e4288-1ef6-403c-aa35-d9a4f7a476a6 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:58.668850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d664e-a987-4a7c-9d8f-62721564c494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:58.669479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d664e-a987-4a7c-9d8f-62721564c494 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:58.669764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d664e-a987-4a7c-9d8f-62721564c494 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:58.670062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d664e-a987-4a7c-9d8f-62721564c494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:58.680343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d664e-a987-4a7c-9d8f-62721564c494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-707d664e-a987-4a7c-9d8f-62721564c494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:11:58.685273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:11:58.686474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:11:58.687583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 577/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:11:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:11:58.692463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0098f-f4d7-4787-af18-932fa2258f31 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:58.707076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:58.791065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0098f-f4d7-4787-af18-932fa2258f31 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:58.824505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586fbee-4da2-4608-87b9-d9626194b2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:58.825115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586fbee-4da2-4608-87b9-d9626194b2ff None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:58.825397 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586fbee-4da2-4608-87b9-d9626194b2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:58.825673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586fbee-4da2-4608-87b9-d9626194b2ff None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:58.826417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586fbee-4da2-4608-87b9-d9626194b2ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:58.826724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586fbee-4da2-4608-87b9-d9626194b2ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:58.828091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586fbee-4da2-4608-87b9-d9626194b2ff None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:58.836038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 580/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:11:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:58.842440 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d664e-a987-4a7c-9d8f-62721564c494 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:58.846199 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:58.940855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d664e-a987-4a7c-9d8f-62721564c494 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:58.974632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b05cb0-2866-4da4-b30e-ed78e5d0bc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:58.975262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05cb0-2866-4da4-b30e-ed78e5d0bc4f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:58.975547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05cb0-2866-4da4-b30e-ed78e5d0bc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:58.975825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b05cb0-2866-4da4-b30e-ed78e5d0bc4f None admin] PATH_INFO: `/v3/users/277c92a382064e9ead25fed14a94e5f1` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:58.976983 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b05cb0-2866-4da4-b30e-ed78e5d0bc4f None admin] RBAC: Authorizing `identity:get_user(user_id=277c92a382064e9ead25fed14a94e5f1)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:58.978455 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b05cb0-2866-4da4-b30e-ed78e5d0bc4f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:58.980068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 578/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:11:58 2022] GET /identity/v3/users/277c92a382064e9ead25fed14a94e5f1 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:58.986446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586fbee-4da2-4608-87b9-d9626194b2ff None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:59.061332 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:59.084131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586fbee-4da2-4608-87b9-d9626194b2ff None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:59.116669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba6897-a5f8-479d-94da-e90fe80e3edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:59.117278 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6897-a5f8-479d-94da-e90fe80e3edc None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:59.117557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6897-a5f8-479d-94da-e90fe80e3edc None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:59.117831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba6897-a5f8-479d-94da-e90fe80e3edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:59.182777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba6897-a5f8-479d-94da-e90fe80e3edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:59.184277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba6897-a5f8-479d-94da-e90fe80e3edc None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:59.256915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:59.280714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 581/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:11:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:11:59.286543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b05cb0-2866-4da4-b30e-ed78e5d0bc4f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:59.357952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:11:59.387478 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b05cb0-2866-4da4-b30e-ed78e5d0bc4f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:59.420302 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b054ea-8121-4504-8fe3-c123637bc86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:59.420933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b054ea-8121-4504-8fe3-c123637bc86e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:59.421211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b054ea-8121-4504-8fe3-c123637bc86e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:59.421482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b054ea-8121-4504-8fe3-c123637bc86e None admin] PATH_INFO: `/v3/projects/2006628d239b415580322da852343523` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:59.422632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b054ea-8121-4504-8fe3-c123637bc86e None admin] RBAC: Authorizing `identity:get_project(project_id=2006628d239b415580322da852343523)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:59.424043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b054ea-8121-4504-8fe3-c123637bc86e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:59.425682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 579/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:11:59 2022] GET /identity/v3/projects/2006628d239b415580322da852343523 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:11:59.431881 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba6897-a5f8-479d-94da-e90fe80e3edc None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:11:59.528683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba6897-a5f8-479d-94da-e90fe80e3edc None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:11:59.561653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5c306-57ed-4103-addb-f6eaf5500f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:11:59.562286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5c306-57ed-4103-addb-f6eaf5500f23 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:11:59.562567 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5c306-57ed-4103-addb-f6eaf5500f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:11:59.562841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5c306-57ed-4103-addb-f6eaf5500f23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:11:59.563625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5c306-57ed-4103-addb-f6eaf5500f23 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=2006628d239b415580322da852343523, user.id=277c92a382064e9ead25fed14a94e5f1) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:11:59.563931 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5c306-57ed-4103-addb-f6eaf5500f23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:11:59.565339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5c306-57ed-4103-addb-f6eaf5500f23 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:11:59.571006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 582/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:11:59 2022] GET /identity/v3/role_assignments?user.id=277c92a382064e9ead25fed14a94e5f1&scope.project.id=2006628d239b415580322da852343523&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:01.611904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf12280-895c-419b-a831-3b1c1cdc8d90 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:01.612448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf12280-895c-419b-a831-3b1c1cdc8d90 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:01.612448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf12280-895c-419b-a831-3b1c1cdc8d90 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:01.613706 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 580/1162] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:12:01.619115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5df79-2377-4764-aeca-ff8c637db03e None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:01.619578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5df79-2377-4764-aeca-ff8c637db03e None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:01.619682 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5df79-2377-4764-aeca-ff8c637db03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:01.638451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-2ba5df79-2377-4764-aeca-ff8c637db03e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:12:01.639689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2ba5df79-2377-4764-aeca-ff8c637db03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:12:01.675185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:01.709699 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 583/1163] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:12:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:12:01.732997 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf12280-895c-419b-a831-3b1c1cdc8d90 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:01.834492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf12280-895c-419b-a831-3b1c1cdc8d90 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:01.868280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccef78-c621-499d-a79f-74fd82ddedfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:01.868810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccef78-c621-499d-a79f-74fd82ddedfc None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:01.869087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccef78-c621-499d-a79f-74fd82ddedfc None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:01.869360 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccef78-c621-499d-a79f-74fd82ddedfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:01.882160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:01.946890 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccef78-c621-499d-a79f-74fd82ddedfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:01.948323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccef78-c621-499d-a79f-74fd82ddedfc None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:02.053973 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 581/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:12:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:12:02.060254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5df79-2377-4764-aeca-ff8c637db03e None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:02.156498 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5df79-2377-4764-aeca-ff8c637db03e None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:02.189809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3118ff-fb0a-454c-be06-8e0fa8ad062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:02.190497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3118ff-fb0a-454c-be06-8e0fa8ad062b None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:02.190773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3118ff-fb0a-454c-be06-8e0fa8ad062b None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:02.191049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3118ff-fb0a-454c-be06-8e0fa8ad062b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:02.197813 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3118ff-fb0a-454c-be06-8e0fa8ad062b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:02.199857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3118ff-fb0a-454c-be06-8e0fa8ad062b None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-0a3118ff-fb0a-454c-be06-8e0fa8ad062b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:12:02.211308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:12:02.212631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:12:02.213506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 584/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 08:12:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:12:02.219096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccef78-c621-499d-a79f-74fd82ddedfc None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:02.259772 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:02.321194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccef78-c621-499d-a79f-74fd82ddedfc None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:02.355644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477e935-16e8-4289-a819-952f573c5fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:02.356265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477e935-16e8-4289-a819-952f573c5fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:02.356542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477e935-16e8-4289-a819-952f573c5fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:02.356809 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477e935-16e8-4289-a819-952f573c5fa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:02.357495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477e935-16e8-4289-a819-952f573c5fa3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:12:02.357795 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477e935-16e8-4289-a819-952f573c5fa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:02.359175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477e935-16e8-4289-a819-952f573c5fa3 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:02.366809 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 582/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 08:12:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:12:04.405614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970333b-8f11-4284-9a21-eead0be99dd3 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:04.406213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970333b-8f11-4284-9a21-eead0be99dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:04.406213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970333b-8f11-4284-9a21-eead0be99dd3 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:04.407572 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 585/1167] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:12:04.413093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470d7b-837c-4d6d-8687-a587c9b9e508 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:04.413593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470d7b-837c-4d6d-8687-a587c9b9e508 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:04.413688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470d7b-837c-4d6d-8687-a587c9b9e508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:04.432457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-7f470d7b-837c-4d6d-8687-a587c9b9e508 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:12:04.434266 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7f470d7b-837c-4d6d-8687-a587c9b9e508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:12:04.501542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 583/1168] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:12:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:12:04.524269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970333b-8f11-4284-9a21-eead0be99dd3 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:04.557158 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:04.631060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970333b-8f11-4284-9a21-eead0be99dd3 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:04.667266 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d93614-fa7f-4cfe-a7dd-a4eff2395781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:04.667914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93614-fa7f-4cfe-a7dd-a4eff2395781 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:04.668188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93614-fa7f-4cfe-a7dd-a4eff2395781 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:04.668458 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93614-fa7f-4cfe-a7dd-a4eff2395781 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:04.669235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d93614-fa7f-4cfe-a7dd-a4eff2395781 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:04.670635 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d93614-fa7f-4cfe-a7dd-a4eff2395781 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:04.687632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 586/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Tue Aug 2 08:12:04 2022] POST /identity/v3/domains => generated 267 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:12:06.744609 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8932-ebd5-4363-bcaf-17ff1b538966 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:06.745183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8932-ebd5-4363-bcaf-17ff1b538966 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:06.745183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb8932-ebd5-4363-bcaf-17ff1b538966 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:06.747120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 584/1170] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:12:06.752446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fea7d-0720-43e8-bfe3-44a81e230bae None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:06.752856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fea7d-0720-43e8-bfe3-44a81e230bae None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:06.752998 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fea7d-0720-43e8-bfe3-44a81e230bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:06.771294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-b88fea7d-0720-43e8-bfe3-44a81e230bae None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:12:06.772517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b88fea7d-0720-43e8-bfe3-44a81e230bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:12:06.840280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 587/1171] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:12:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:12:06.864044 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb8932-ebd5-4363-bcaf-17ff1b538966 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:06.901482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:06.978113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb8932-ebd5-4363-bcaf-17ff1b538966 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:07.030951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fafe57-cc53-482d-8b09-a7e8f7de841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:07.031825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fafe57-cc53-482d-8b09-a7e8f7de841a None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:07.032261 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fafe57-cc53-482d-8b09-a7e8f7de841a None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:07.032685 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fafe57-cc53-482d-8b09-a7e8f7de841a None admin] PATH_INFO: `/v3/domains/d03ddfd1dd2744e4bb9ddfb0140c96ea` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:07.049583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fafe57-cc53-482d-8b09-a7e8f7de841a None admin] RBAC: Authorizing `identity:get_domain(domain_id=d03ddfd1dd2744e4bb9ddfb0140c96ea)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:07.052004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fafe57-cc53-482d-8b09-a7e8f7de841a None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:07.054770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 585/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Tue Aug 2 08:12:06 2022] GET /identity/v3/domains/d03ddfd1dd2744e4bb9ddfb0140c96ea => generated 267 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:07.060678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fea7d-0720-43e8-bfe3-44a81e230bae None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:07.081442 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:07.162769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fea7d-0720-43e8-bfe3-44a81e230bae None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:07.196977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcf02f-d46b-45e5-90b1-4eb45008f654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:07.197600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcf02f-d46b-45e5-90b1-4eb45008f654 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:07.197878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcf02f-d46b-45e5-90b1-4eb45008f654 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:07.198180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcf02f-d46b-45e5-90b1-4eb45008f654 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:07.198875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcf02f-d46b-45e5-90b1-4eb45008f654 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:07.200294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcf02f-d46b-45e5-90b1-4eb45008f654 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:07.227379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 588/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:12:07 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:12:09.330483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9ef9c-57d3-41ec-b6ee-700e16244bf4 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:09.331122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9ef9c-57d3-41ec-b6ee-700e16244bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:09.331244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9ef9c-57d3-41ec-b6ee-700e16244bf4 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:09.332667 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 586/1174] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:12:09.338678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c1526-d230-4a14-96c2-46be4db86750 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:09.339231 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c1526-d230-4a14-96c2-46be4db86750 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:09.339231 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c1526-d230-4a14-96c2-46be4db86750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:09.359052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-350c1526-d230-4a14-96c2-46be4db86750 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:12:09.360297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-350c1526-d230-4a14-96c2-46be4db86750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:12:09.437550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 589/1175] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:12:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:12:09.463125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9ef9c-57d3-41ec-b6ee-700e16244bf4 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:09.570676 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:09.579074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9ef9c-57d3-41ec-b6ee-700e16244bf4 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:09.615984 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b52f52-57c7-4006-8291-6dd7e2af8860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:09.616539 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52f52-57c7-4006-8291-6dd7e2af8860 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:09.616817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52f52-57c7-4006-8291-6dd7e2af8860 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:09.617088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52f52-57c7-4006-8291-6dd7e2af8860 None admin] PATH_INFO: `/v3/domains/d03ddfd1dd2744e4bb9ddfb0140c96ea` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:09.618302 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b52f52-57c7-4006-8291-6dd7e2af8860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d03ddfd1dd2744e4bb9ddfb0140c96ea)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:09.619744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b52f52-57c7-4006-8291-6dd7e2af8860 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:09.621999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 587/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Tue Aug 2 08:12:09 2022] GET /identity/v3/domains/d03ddfd1dd2744e4bb9ddfb0140c96ea => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:09.627919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c1526-d230-4a14-96c2-46be4db86750 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:09.630138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:09.760789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c1526-d230-4a14-96c2-46be4db86750 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:09.801514 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41397d-37f9-4afb-8577-e62601ad0680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:09.802177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41397d-37f9-4afb-8577-e62601ad0680 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:09.802460 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41397d-37f9-4afb-8577-e62601ad0680 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:09.802734 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41397d-37f9-4afb-8577-e62601ad0680 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:09.803445 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41397d-37f9-4afb-8577-e62601ad0680 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:09.804926 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41397d-37f9-4afb-8577-e62601ad0680 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:09.829921 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 590/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:12:09 2022] POST /identity/v3/users => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:12:11.905769 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05d31d-c70a-4433-9f41-0a87d7afe692 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:11.906350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05d31d-c70a-4433-9f41-0a87d7afe692 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:11.906350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05d31d-c70a-4433-9f41-0a87d7afe692 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:11.907745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 588/1178] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:12:11.913316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd38a71-3d70-45d8-87d9-c952de9cc2d2 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:11.914099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd38a71-3d70-45d8-87d9-c952de9cc2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:11.914195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd38a71-3d70-45d8-87d9-c952de9cc2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:11.932441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-1cd38a71-3d70-45d8-87d9-c952de9cc2d2 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:12:11.933655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-1cd38a71-3d70-45d8-87d9-c952de9cc2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:12:11.992135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:12.007242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 591/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:12:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:12:12.031630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05d31d-c70a-4433-9f41-0a87d7afe692 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:12.136884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05d31d-c70a-4433-9f41-0a87d7afe692 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:12.172368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abbbde-b58d-4b48-a878-5a6b9f7e694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:12.172927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbbde-b58d-4b48-a878-5a6b9f7e694b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:12.173202 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbbde-b58d-4b48-a878-5a6b9f7e694b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:12.173471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbbde-b58d-4b48-a878-5a6b9f7e694b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:12.185233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abbbde-b58d-4b48-a878-5a6b9f7e694b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-75abbbde-b58d-4b48-a878-5a6b9f7e694b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:12:12.190119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:12:12.191262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:12:12.192547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 589/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:12:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:12:12.197806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd38a71-3d70-45d8-87d9-c952de9cc2d2 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:12.297456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd38a71-3d70-45d8-87d9-c952de9cc2d2 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:12.334341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a8ddf-059a-45e0-b594-bfd92724ce88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:12.335162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8ddf-059a-45e0-b594-bfd92724ce88 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:12.335480 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8ddf-059a-45e0-b594-bfd92724ce88 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:12.335791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8ddf-059a-45e0-b594-bfd92724ce88 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:12.336562 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a8ddf-059a-45e0-b594-bfd92724ce88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:12:12.336897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a8ddf-059a-45e0-b594-bfd92724ce88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:12.338344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a8ddf-059a-45e0-b594-bfd92724ce88 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:12.347132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 592/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:12.353092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abbbde-b58d-4b48-a878-5a6b9f7e694b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:12.382201 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:12.460244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abbbde-b58d-4b48-a878-5a6b9f7e694b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:12.495237 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8fae4-5905-41bf-9ff0-5fb6bf1f2521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:12.496406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8fae4-5905-41bf-9ff0-5fb6bf1f2521 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:12.496691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8fae4-5905-41bf-9ff0-5fb6bf1f2521 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:12.496971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8fae4-5905-41bf-9ff0-5fb6bf1f2521 None admin] PATH_INFO: `/v3/users/7904a7747521406d9a16ba7cae9f2269` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:12.510764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8fae4-5905-41bf-9ff0-5fb6bf1f2521 None admin] RBAC: Authorizing `identity:get_user(user_id=7904a7747521406d9a16ba7cae9f2269)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:12.512785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8fae4-5905-41bf-9ff0-5fb6bf1f2521 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:12.514541 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 590/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:12:12 2022] GET /identity/v3/users/7904a7747521406d9a16ba7cae9f2269 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:12.520607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a8ddf-059a-45e0-b594-bfd92724ce88 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:12.572982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:12.628983 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a8ddf-059a-45e0-b594-bfd92724ce88 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:12.661593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d934a3e-355d-4d79-8fc1-2cb9cb9a76b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:12.662229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d934a3e-355d-4d79-8fc1-2cb9cb9a76b6 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:12.662507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d934a3e-355d-4d79-8fc1-2cb9cb9a76b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:12.662778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d934a3e-355d-4d79-8fc1-2cb9cb9a76b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:12.735695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d934a3e-355d-4d79-8fc1-2cb9cb9a76b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:12.737059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d934a3e-355d-4d79-8fc1-2cb9cb9a76b6 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:12.787486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:12.846394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 593/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:12:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:12:12.855976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8fae4-5905-41bf-9ff0-5fb6bf1f2521 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:12.942189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:12.962779 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8fae4-5905-41bf-9ff0-5fb6bf1f2521 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:13.017521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593ab01-823d-40b9-b534-fe3b0ca356bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:13.018540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ab01-823d-40b9-b534-fe3b0ca356bf None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:13.019039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ab01-823d-40b9-b534-fe3b0ca356bf None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:13.019530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593ab01-823d-40b9-b534-fe3b0ca356bf None admin] PATH_INFO: `/v3/projects/c92c6cfc62bd496390bdd960abd6e91b` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:13.021462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ab01-823d-40b9-b534-fe3b0ca356bf None admin] RBAC: Authorizing `identity:get_project(project_id=c92c6cfc62bd496390bdd960abd6e91b)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:13.023071 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593ab01-823d-40b9-b534-fe3b0ca356bf None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:13.024807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 591/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:12:12 2022] GET /identity/v3/projects/c92c6cfc62bd496390bdd960abd6e91b => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:13.031783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d934a3e-355d-4d79-8fc1-2cb9cb9a76b6 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:13.136964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d934a3e-355d-4d79-8fc1-2cb9cb9a76b6 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:13.172219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf690db3-fb02-47c6-ab7a-3ef17ed40f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:13.172840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf690db3-fb02-47c6-ab7a-3ef17ed40f2e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:13.173131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf690db3-fb02-47c6-ab7a-3ef17ed40f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:13.173407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf690db3-fb02-47c6-ab7a-3ef17ed40f2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:13.174229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf690db3-fb02-47c6-ab7a-3ef17ed40f2e None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=c92c6cfc62bd496390bdd960abd6e91b, user.id=7904a7747521406d9a16ba7cae9f2269) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:12:13.174543 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf690db3-fb02-47c6-ab7a-3ef17ed40f2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:13.175964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf690db3-fb02-47c6-ab7a-3ef17ed40f2e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:13.181503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 594/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:12:13 2022] GET /identity/v3/role_assignments?user.id=7904a7747521406d9a16ba7cae9f2269&scope.project.id=c92c6cfc62bd496390bdd960abd6e91b&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:15.159321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dddc35-cc2c-4dd0-bc9d-61ce59e1fa22 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:15.159873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dddc35-cc2c-4dd0-bc9d-61ce59e1fa22 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:15.159873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dddc35-cc2c-4dd0-bc9d-61ce59e1fa22 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:15.161230 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 592/1186] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:12:15.167073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98eb5f-12e2-4b2a-95a1-5510cac67cd6 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:15.168173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98eb5f-12e2-4b2a-95a1-5510cac67cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:15.168173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98eb5f-12e2-4b2a-95a1-5510cac67cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:15.186314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-ea98eb5f-12e2-4b2a-95a1-5510cac67cd6 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:12:15.187539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ea98eb5f-12e2-4b2a-95a1-5510cac67cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:12:15.197859 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:15.263893 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 595/1187] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:12:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:12:15.286273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dddc35-cc2c-4dd0-bc9d-61ce59e1fa22 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:15.390056 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dddc35-cc2c-4dd0-bc9d-61ce59e1fa22 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:15.426064 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077669c3-7fad-4e8d-aa1c-9e7a2fb7443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:15.426624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077669c3-7fad-4e8d-aa1c-9e7a2fb7443a None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:15.426900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077669c3-7fad-4e8d-aa1c-9e7a2fb7443a None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:15.427171 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077669c3-7fad-4e8d-aa1c-9e7a2fb7443a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:15.437479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077669c3-7fad-4e8d-aa1c-9e7a2fb7443a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-077669c3-7fad-4e8d-aa1c-9e7a2fb7443a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:12:15.442379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:12:15.443501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:12:15.444530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 593/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:12:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:12:15.452421 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98eb5f-12e2-4b2a-95a1-5510cac67cd6 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:15.564690 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98eb5f-12e2-4b2a-95a1-5510cac67cd6 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:15.605694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc074b1-b5d2-463b-bfdb-7cd2362d07bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:15.606352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc074b1-b5d2-463b-bfdb-7cd2362d07bb None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:15.606632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc074b1-b5d2-463b-bfdb-7cd2362d07bb None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:15.606905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc074b1-b5d2-463b-bfdb-7cd2362d07bb None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:15.607631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc074b1-b5d2-463b-bfdb-7cd2362d07bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:12:15.607934 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc074b1-b5d2-463b-bfdb-7cd2362d07bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:15.609298 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc074b1-b5d2-463b-bfdb-7cd2362d07bb None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:15.618056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 596/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:15.623938 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077669c3-7fad-4e8d-aa1c-9e7a2fb7443a None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:15.635347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:15.741337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077669c3-7fad-4e8d-aa1c-9e7a2fb7443a None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:15.776172 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc002ea3-bcc6-4ede-aff8-9f3b275c921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:15.777360 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc002ea3-bcc6-4ede-aff8-9f3b275c921f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:15.777637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc002ea3-bcc6-4ede-aff8-9f3b275c921f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:15.777907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc002ea3-bcc6-4ede-aff8-9f3b275c921f None admin] PATH_INFO: `/v3/users/7904a7747521406d9a16ba7cae9f2269` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:15.779107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc002ea3-bcc6-4ede-aff8-9f3b275c921f None admin] RBAC: Authorizing `identity:get_user(user_id=7904a7747521406d9a16ba7cae9f2269)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:15.780532 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc002ea3-bcc6-4ede-aff8-9f3b275c921f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:15.782159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 594/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:12:15 2022] GET /identity/v3/users/7904a7747521406d9a16ba7cae9f2269 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:15.788215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc074b1-b5d2-463b-bfdb-7cd2362d07bb None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:15.797810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:15.889999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc074b1-b5d2-463b-bfdb-7cd2362d07bb None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:15.924001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cc053-a2e0-4553-8ae3-fadeb78c41dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:15.924657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cc053-a2e0-4553-8ae3-fadeb78c41dd None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:15.924934 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cc053-a2e0-4553-8ae3-fadeb78c41dd None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:15.925211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cc053-a2e0-4553-8ae3-fadeb78c41dd None admin] PATH_INFO: `/v3/projects/c92c6cfc62bd496390bdd960abd6e91b` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:15.926438 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cc053-a2e0-4553-8ae3-fadeb78c41dd None admin] RBAC: Authorizing `identity:get_project(project_id=c92c6cfc62bd496390bdd960abd6e91b)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:15.927869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cc053-a2e0-4553-8ae3-fadeb78c41dd None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:15.929557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 597/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:12:15 2022] GET /identity/v3/projects/c92c6cfc62bd496390bdd960abd6e91b => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:15.936296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc002ea3-bcc6-4ede-aff8-9f3b275c921f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:16.012396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:16.035074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc002ea3-bcc6-4ede-aff8-9f3b275c921f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:16.068679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f2708-b786-4096-b116-98348e45bac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:16.069346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f2708-b786-4096-b116-98348e45bac2 None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:16.069625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f2708-b786-4096-b116-98348e45bac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:16.069897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f2708-b786-4096-b116-98348e45bac2 None admin] PATH_INFO: `/v3/projects/c92c6cfc62bd496390bdd960abd6e91b/users/7904a7747521406d9a16ba7cae9f2269/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:16.071845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f2708-b786-4096-b116-98348e45bac2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c92c6cfc62bd496390bdd960abd6e91b, user_id=7904a7747521406d9a16ba7cae9f2269, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:16.073372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f2708-b786-4096-b116-98348e45bac2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:16.088441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 595/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:12:15 2022] PUT /identity/v3/projects/c92c6cfc62bd496390bdd960abd6e91b/users/7904a7747521406d9a16ba7cae9f2269/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:12:18.066286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1bbb1-47ed-4967-b493-f666253eb467 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:18.066834 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1bbb1-47ed-4967-b493-f666253eb467 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:18.067014 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1bbb1-47ed-4967-b493-f666253eb467 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:18.068446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 598/1193] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:12:18.074447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953831c-c039-464c-8919-d6735d098160 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:18.075180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953831c-c039-464c-8919-d6735d098160 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:18.075180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953831c-c039-464c-8919-d6735d098160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:18.105780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-9953831c-c039-464c-8919-d6735d098160 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:12:18.107053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9953831c-c039-464c-8919-d6735d098160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:12:18.176300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 596/1194] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:12:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:12:18.199691 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1bbb1-47ed-4967-b493-f666253eb467 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:18.278581 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:18.305452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1bbb1-47ed-4967-b493-f666253eb467 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:18.339898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5f674-0cd7-415b-82c0-0c7c3567c179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:18.340456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5f674-0cd7-415b-82c0-0c7c3567c179 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:18.340730 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5f674-0cd7-415b-82c0-0c7c3567c179 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:18.340994 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5f674-0cd7-415b-82c0-0c7c3567c179 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:18.351729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5f674-0cd7-415b-82c0-0c7c3567c179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-05a5f674-0cd7-415b-82c0-0c7c3567c179 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:12:18.357370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:12:18.358533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:12:18.360367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 599/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:12:18.364670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953831c-c039-464c-8919-d6735d098160 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:18.429694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:18.465917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953831c-c039-464c-8919-d6735d098160 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:18.499559 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d84b2-95ea-4a85-90e5-7698ad310c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:18.500175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d84b2-95ea-4a85-90e5-7698ad310c40 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:18.500454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d84b2-95ea-4a85-90e5-7698ad310c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:18.500731 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d84b2-95ea-4a85-90e5-7698ad310c40 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:18.501437 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d84b2-95ea-4a85-90e5-7698ad310c40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:12:18.501737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d84b2-95ea-4a85-90e5-7698ad310c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:18.503133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d84b2-95ea-4a85-90e5-7698ad310c40 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:18.511264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 597/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:18.517125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5f674-0cd7-415b-82c0-0c7c3567c179 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:18.618391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5f674-0cd7-415b-82c0-0c7c3567c179 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:18.653197 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe22820-3ad3-4258-91ac-005f1e26b1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:18.653843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe22820-3ad3-4258-91ac-005f1e26b1bb None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:18.654159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe22820-3ad3-4258-91ac-005f1e26b1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:18.654441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe22820-3ad3-4258-91ac-005f1e26b1bb None admin] PATH_INFO: `/v3/users/7904a7747521406d9a16ba7cae9f2269` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:18.655628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe22820-3ad3-4258-91ac-005f1e26b1bb None admin] RBAC: Authorizing `identity:get_user(user_id=7904a7747521406d9a16ba7cae9f2269)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:18.657051 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe22820-3ad3-4258-91ac-005f1e26b1bb None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:18.658748 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 600/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 08:12:18 2022] GET /identity/v3/users/7904a7747521406d9a16ba7cae9f2269 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:18.665224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d84b2-95ea-4a85-90e5-7698ad310c40 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:18.769317 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d84b2-95ea-4a85-90e5-7698ad310c40 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:18.801463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:18.810126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb05505-9463-488e-a494-fe8b6d34fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:18.810752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb05505-9463-488e-a494-fe8b6d34fbcd None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:18.811038 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb05505-9463-488e-a494-fe8b6d34fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:18.811319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb05505-9463-488e-a494-fe8b6d34fbcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:18.889513 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb05505-9463-488e-a494-fe8b6d34fbcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:18.890910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb05505-9463-488e-a494-fe8b6d34fbcd None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:18.990649 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 598/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:12:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:12:18.997141 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe22820-3ad3-4258-91ac-005f1e26b1bb None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:19.000020 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:19.102080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe22820-3ad3-4258-91ac-005f1e26b1bb None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:19.138033 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2474ef3-2349-4c6a-9a05-7e46a2574b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:19.138714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2474ef3-2349-4c6a-9a05-7e46a2574b99 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:19.138997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2474ef3-2349-4c6a-9a05-7e46a2574b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:19.139273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2474ef3-2349-4c6a-9a05-7e46a2574b99 None admin] PATH_INFO: `/v3/projects/c92c6cfc62bd496390bdd960abd6e91b` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:19.140513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2474ef3-2349-4c6a-9a05-7e46a2574b99 None admin] RBAC: Authorizing `identity:get_project(project_id=c92c6cfc62bd496390bdd960abd6e91b)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:19.141887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2474ef3-2349-4c6a-9a05-7e46a2574b99 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:19.143802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 601/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 08:12:18 2022] GET /identity/v3/projects/c92c6cfc62bd496390bdd960abd6e91b => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:19.151584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb05505-9463-488e-a494-fe8b6d34fbcd None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:12:19.180039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:19.252867 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb05505-9463-488e-a494-fe8b6d34fbcd None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:12:19.286691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343a754-cee8-476b-b36d-c70ebfa45873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:12:19.287301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a754-cee8-476b-b36d-c70ebfa45873 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:12:19.287582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a754-cee8-476b-b36d-c70ebfa45873 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:12:19.287858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a754-cee8-476b-b36d-c70ebfa45873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:12:19.288896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343a754-cee8-476b-b36d-c70ebfa45873 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=c92c6cfc62bd496390bdd960abd6e91b, user.id=7904a7747521406d9a16ba7cae9f2269) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:12:19.289206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343a754-cee8-476b-b36d-c70ebfa45873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:12:19.290663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343a754-cee8-476b-b36d-c70ebfa45873 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:12:19.296966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 599/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:12:19 2022] GET /identity/v3/role_assignments?user.id=7904a7747521406d9a16ba7cae9f2269&scope.project.id=c92c6cfc62bd496390bdd960abd6e91b&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:12:29.132988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=65 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:12:29.295127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=54 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:16.663667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d99615-32de-478a-a744-1721817d0a49 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:16.664328 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d99615-32de-478a-a744-1721817d0a49 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:16.664328 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d99615-32de-478a-a744-1721817d0a49 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:16.666810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 602/1201] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:13:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:13:16.674099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ceb03-9e62-41f5-9cf4-c70ba7cf5f3c None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:16.674719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ceb03-9e62-41f5-9cf4-c70ba7cf5f3c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:16.674844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ceb03-9e62-41f5-9cf4-c70ba7cf5f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:16.696878 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-fc5ceb03-9e62-41f5-9cf4-c70ba7cf5f3c None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:13:16.698360 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fc5ceb03-9e62-41f5-9cf4-c70ba7cf5f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:13:16.790952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 600/1202] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:13:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:13:16.819255 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d99615-32de-478a-a744-1721817d0a49 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:16.987260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d99615-32de-478a-a744-1721817d0a49 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:17.037894 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3cad-501c-4343-8e9e-dcbf69eb10e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:17.038718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3cad-501c-4343-8e9e-dcbf69eb10e1 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:17.039026 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3cad-501c-4343-8e9e-dcbf69eb10e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:17.039318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3cad-501c-4343-8e9e-dcbf69eb10e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:17.053610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a3cad-501c-4343-8e9e-dcbf69eb10e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:17.055400 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a3cad-501c-4343-8e9e-dcbf69eb10e1 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-e03a3cad-501c-4343-8e9e-dcbf69eb10e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:17.075928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:17.077003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:17.077992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:17.077992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:17.077992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:17.077992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:17.077992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 603/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:17.085176 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ceb03-9e62-41f5-9cf4-c70ba7cf5f3c None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:17.230907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ceb03-9e62-41f5-9cf4-c70ba7cf5f3c None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:17.275069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:17.281972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38926a4-aaa0-4521-ba7b-ed294da8e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:17.282759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38926a4-aaa0-4521-ba7b-ed294da8e97c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:17.283049 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38926a4-aaa0-4521-ba7b-ed294da8e97c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:17.283337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38926a4-aaa0-4521-ba7b-ed294da8e97c None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:17.284046 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38926a4-aaa0-4521-ba7b-ed294da8e97c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:17.284356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38926a4-aaa0-4521-ba7b-ed294da8e97c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:17.285736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38926a4-aaa0-4521-ba7b-ed294da8e97c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:17.301232 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 601/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:17.307382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3cad-501c-4343-8e9e-dcbf69eb10e1 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:17.395534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:17.493597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3cad-501c-4343-8e9e-dcbf69eb10e1 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:17.541604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e52b0-8bb7-4548-ab35-24f51c8f9b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:17.542359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e52b0-8bb7-4548-ab35-24f51c8f9b87 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:17.542669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e52b0-8bb7-4548-ab35-24f51c8f9b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:17.542907 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e52b0-8bb7-4548-ab35-24f51c8f9b87 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:17.543724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e52b0-8bb7-4548-ab35-24f51c8f9b87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:17.545183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e52b0-8bb7-4548-ab35-24f51c8f9b87 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:17.578987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 604/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 08:13:17 2022] POST /identity/v3/users => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:13:20.079447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2b25-8246-4665-ab84-696a5ea4a02a None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:20.080015 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2b25-8246-4665-ab84-696a5ea4a02a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:20.080015 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2b25-8246-4665-ab84-696a5ea4a02a None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:20.081823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 602/1206] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:13:20.088894 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc63cd-810a-4dde-b992-6b0f59382e0f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:20.089377 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc63cd-810a-4dde-b992-6b0f59382e0f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:20.089604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc63cd-810a-4dde-b992-6b0f59382e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:20.115234 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-68cc63cd-810a-4dde-b992-6b0f59382e0f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:13:20.117240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-68cc63cd-810a-4dde-b992-6b0f59382e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:13:20.209084 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 605/1207] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:13:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:13:20.235178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e2b25-8246-4665-ab84-696a5ea4a02a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:20.365257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e2b25-8246-4665-ab84-696a5ea4a02a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:20.406451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161695e4-d606-49a4-99b7-4cc66d0a9d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:20.407122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161695e4-d606-49a4-99b7-4cc66d0a9d37 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:20.407394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161695e4-d606-49a4-99b7-4cc66d0a9d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:20.407662 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161695e4-d606-49a4-99b7-4cc66d0a9d37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:20.421440 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161695e4-d606-49a4-99b7-4cc66d0a9d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-161695e4-d606-49a4-99b7-4cc66d0a9d37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:13:20.426348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:20.428798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:20.429653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 603/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:13:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:20.434167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc63cd-810a-4dde-b992-6b0f59382e0f None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:20.478483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:20.557038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc63cd-810a-4dde-b992-6b0f59382e0f None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:20.598107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d8455-b7eb-415e-8a47-54cb0e1932f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:20.598746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d8455-b7eb-415e-8a47-54cb0e1932f8 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:20.599028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d8455-b7eb-415e-8a47-54cb0e1932f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:20.599303 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d8455-b7eb-415e-8a47-54cb0e1932f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:20.600022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d8455-b7eb-415e-8a47-54cb0e1932f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:20.600327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d8455-b7eb-415e-8a47-54cb0e1932f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:20.601705 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d8455-b7eb-415e-8a47-54cb0e1932f8 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:20.612325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 606/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:13:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:20.617154 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161695e4-d606-49a4-99b7-4cc66d0a9d37 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:20.687584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:20.748085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161695e4-d606-49a4-99b7-4cc66d0a9d37 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:20.785800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc06387-0a16-4cda-9cde-d6474dd123f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:20.787521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06387-0a16-4cda-9cde-d6474dd123f4 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:20.787521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06387-0a16-4cda-9cde-d6474dd123f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:20.787521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc06387-0a16-4cda-9cde-d6474dd123f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:20.799649 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc06387-0a16-4cda-9cde-d6474dd123f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:20.801254 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc06387-0a16-4cda-9cde-d6474dd123f4 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-8dc06387-0a16-4cda-9cde-d6474dd123f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:20.817921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:20.818922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:20.820339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:20.820339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:20.820339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:20.820339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:20.820339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 604/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:20.825065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d8455-b7eb-415e-8a47-54cb0e1932f8 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:20.936009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:20.940695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d8455-b7eb-415e-8a47-54cb0e1932f8 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:20.983078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e059b2-c294-4302-b683-fb3520c76740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:20.984217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e059b2-c294-4302-b683-fb3520c76740 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:20.984217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e059b2-c294-4302-b683-fb3520c76740 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:20.984217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e059b2-c294-4302-b683-fb3520c76740 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:20.985075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e059b2-c294-4302-b683-fb3520c76740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:20.985525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e059b2-c294-4302-b683-fb3520c76740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:20.986847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e059b2-c294-4302-b683-fb3520c76740 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:21.004439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 607/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:21.010517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc06387-0a16-4cda-9cde-d6474dd123f4 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:21.127822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc06387-0a16-4cda-9cde-d6474dd123f4 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:21.129508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:21.172265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2526-02a2-4157-9fa5-7ec44588aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:21.173106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2526-02a2-4157-9fa5-7ec44588aa26 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:21.173448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2526-02a2-4157-9fa5-7ec44588aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:21.173782 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2526-02a2-4157-9fa5-7ec44588aa26 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:21.182686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2526-02a2-4157-9fa5-7ec44588aa26 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:21.184130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2526-02a2-4157-9fa5-7ec44588aa26 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-becd2526-02a2-4157-9fa5-7ec44588aa26 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:13:21.196104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:21.201974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:21.203294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:21.203294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:21.203294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:13:21.203294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:13:21.203294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:13:21.203294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:13:21.203294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:13:21.203294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:13:21.203294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:21.203294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:21.203294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 605/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:21.205620 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e059b2-c294-4302-b683-fb3520c76740 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:21.332040 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e059b2-c294-4302-b683-fb3520c76740 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:21.375018 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7860d-e5a6-4a37-895f-6037d04a1d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:21.375607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7860d-e5a6-4a37-895f-6037d04a1d9e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:21.375933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7860d-e5a6-4a37-895f-6037d04a1d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:21.376252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7860d-e5a6-4a37-895f-6037d04a1d9e None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:21.377151 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7860d-e5a6-4a37-895f-6037d04a1d9e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:21.377496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7860d-e5a6-4a37-895f-6037d04a1d9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:21.379047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7860d-e5a6-4a37-895f-6037d04a1d9e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:21.401603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 608/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 08:13:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:21.408969 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2526-02a2-4157-9fa5-7ec44588aa26 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:21.566990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2526-02a2-4157-9fa5-7ec44588aa26 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:21.608913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3288c-5c24-48b8-831f-7ce6cfc3fc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:21.609616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3288c-5c24-48b8-831f-7ce6cfc3fc23 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:21.609895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3288c-5c24-48b8-831f-7ce6cfc3fc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:21.610199 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3288c-5c24-48b8-831f-7ce6cfc3fc23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:21.649733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:21.696954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3288c-5c24-48b8-831f-7ce6cfc3fc23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:21.698856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3288c-5c24-48b8-831f-7ce6cfc3fc23 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:21.824711 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 606/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:13:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:13:21.831213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7860d-e5a6-4a37-895f-6037d04a1d9e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:21.855995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:21.953473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7860d-e5a6-4a37-895f-6037d04a1d9e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:21.997373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001af12b-9790-4594-a494-b48db4d2edc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:21.998133 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001af12b-9790-4594-a494-b48db4d2edc3 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:21.998744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001af12b-9790-4594-a494-b48db4d2edc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:21.998744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001af12b-9790-4594-a494-b48db4d2edc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:22.012489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001af12b-9790-4594-a494-b48db4d2edc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:22.014219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001af12b-9790-4594-a494-b48db4d2edc3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-001af12b-9790-4594-a494-b48db4d2edc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:22.031657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:22.034570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:22.037037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:22.037037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:22.037037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:22.037037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:22.037037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 609/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:13:22.041214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3288c-5c24-48b8-831f-7ce6cfc3fc23 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:22.143845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:22.191972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3288c-5c24-48b8-831f-7ce6cfc3fc23 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:22.246883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929b040-a8f9-4397-9b29-da58487f365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:22.247811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b040-a8f9-4397-9b29-da58487f365c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:22.248098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b040-a8f9-4397-9b29-da58487f365c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:22.248378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929b040-a8f9-4397-9b29-da58487f365c None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:22.249105 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929b040-a8f9-4397-9b29-da58487f365c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:22.249416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929b040-a8f9-4397-9b29-da58487f365c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:22.250904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929b040-a8f9-4397-9b29-da58487f365c None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:22.265109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 607/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:22.271161 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001af12b-9790-4594-a494-b48db4d2edc3 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:22.362504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:22.400932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001af12b-9790-4594-a494-b48db4d2edc3 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:22.457258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48465b90-7776-42f3-8ca6-ed1502125add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:22.458099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465b90-7776-42f3-8ca6-ed1502125add None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:22.458267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465b90-7776-42f3-8ca6-ed1502125add None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:22.458546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465b90-7776-42f3-8ca6-ed1502125add None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:22.467128 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48465b90-7776-42f3-8ca6-ed1502125add None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:22.468645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48465b90-7776-42f3-8ca6-ed1502125add None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-48465b90-7776-42f3-8ca6-ed1502125add None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:13:22.480655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:22.481698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:22.482776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:13:22.482776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:13:22.482776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:13:22.482776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:13:22.482776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:13:22.482776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:13:22.482776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:22.482776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:22.482776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 610/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:13:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:13:22.489280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929b040-a8f9-4397-9b29-da58487f365c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:22.625499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929b040-a8f9-4397-9b29-da58487f365c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:22.648265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:22.663367 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baad5d-42f4-4a89-a297-3c42e0b2e4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:22.663913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baad5d-42f4-4a89-a297-3c42e0b2e4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:22.664197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baad5d-42f4-4a89-a297-3c42e0b2e4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:22.664498 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baad5d-42f4-4a89-a297-3c42e0b2e4f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:22.665242 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97baad5d-42f4-4a89-a297-3c42e0b2e4f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:22.665925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97baad5d-42f4-4a89-a297-3c42e0b2e4f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:22.667034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97baad5d-42f4-4a89-a297-3c42e0b2e4f2 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:22.681946 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 608/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:22.688877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48465b90-7776-42f3-8ca6-ed1502125add None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:22.807351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48465b90-7776-42f3-8ca6-ed1502125add None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:22.859309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:22.868679 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86563f5e-3cb0-418b-858a-393220740016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:22.870197 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86563f5e-3cb0-418b-858a-393220740016 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:22.870689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86563f5e-3cb0-418b-858a-393220740016 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:22.871172 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86563f5e-3cb0-418b-858a-393220740016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:22.872864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86563f5e-3cb0-418b-858a-393220740016 None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=3318842c46ec4c6d9b7b1f55c9fab62b) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:22.875405 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86563f5e-3cb0-418b-858a-393220740016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:22.876645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86563f5e-3cb0-418b-858a-393220740016 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:22.885875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 611/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:13:22 2022] GET /identity/v3/role_assignments?user.id=3318842c46ec4c6d9b7b1f55c9fab62b&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:25.025012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e474bc-e3d7-4a83-a66e-7b0ad317e429 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:25.025603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e474bc-e3d7-4a83-a66e-7b0ad317e429 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:25.026234 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e474bc-e3d7-4a83-a66e-7b0ad317e429 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:25.028460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 609/1220] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:13:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:13:25.040788 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bb584-dcbc-4105-8a14-dd06a1763c7b None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:25.041389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bb584-dcbc-4105-8a14-dd06a1763c7b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:25.041389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bb584-dcbc-4105-8a14-dd06a1763c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:25.066722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-330bb584-dcbc-4105-8a14-dd06a1763c7b None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:13:25.067945 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-330bb584-dcbc-4105-8a14-dd06a1763c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:13:25.157783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 612/1221] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:13:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:13:25.182892 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e474bc-e3d7-4a83-a66e-7b0ad317e429 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:25.307112 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e474bc-e3d7-4a83-a66e-7b0ad317e429 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:25.360308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d67d-ae93-491f-9278-572d4b9a76e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:25.361277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d67d-ae93-491f-9278-572d4b9a76e6 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:25.361574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d67d-ae93-491f-9278-572d4b9a76e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:25.361882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600d67d-ae93-491f-9278-572d4b9a76e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:25.374789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600d67d-ae93-491f-9278-572d4b9a76e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-4600d67d-ae93-491f-9278-572d4b9a76e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:13:25.380618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:25.381916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:25.383079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 610/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:13:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:25.388512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bb584-dcbc-4105-8a14-dd06a1763c7b None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:25.523742 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bb584-dcbc-4105-8a14-dd06a1763c7b None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:25.553963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:25.567224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd500e-ab7f-4f39-a97b-d35bcbbe7e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:25.567760 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd500e-ab7f-4f39-a97b-d35bcbbe7e9c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:25.568035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd500e-ab7f-4f39-a97b-d35bcbbe7e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:25.568308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd500e-ab7f-4f39-a97b-d35bcbbe7e9c None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:25.569039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd500e-ab7f-4f39-a97b-d35bcbbe7e9c None admin] RBAC: Adding query filter params (name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:25.569337 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd500e-ab7f-4f39-a97b-d35bcbbe7e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:25.570795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd500e-ab7f-4f39-a97b-d35bcbbe7e9c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:25.579768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 613/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:13:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:25.585969 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d67d-ae93-491f-9278-572d4b9a76e6 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:25.636181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:25.716695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600d67d-ae93-491f-9278-572d4b9a76e6 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:25.761314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4395b-6d93-49f3-a133-f51d7673bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:25.761964 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4395b-6d93-49f3-a133-f51d7673bc6d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:25.762292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4395b-6d93-49f3-a133-f51d7673bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:25.762556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4395b-6d93-49f3-a133-f51d7673bc6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:25.775016 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4395b-6d93-49f3-a133-f51d7673bc6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:25.776598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4395b-6d93-49f3-a133-f51d7673bc6d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-c4a4395b-6d93-49f3-a133-f51d7673bc6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:25.794828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:25.801998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:25.803032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:25.803032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:25.803032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:25.803032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:25.803032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 611/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:25.803319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd500e-ab7f-4f39-a97b-d35bcbbe7e9c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:25.924353 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd500e-ab7f-4f39-a97b-d35bcbbe7e9c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:25.962708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140efdec-3b86-4d7c-9f5b-a582d4eb4b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:25.963735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140efdec-3b86-4d7c-9f5b-a582d4eb4b45 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:25.964176 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140efdec-3b86-4d7c-9f5b-a582d4eb4b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:25.964598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140efdec-3b86-4d7c-9f5b-a582d4eb4b45 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:25.965413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140efdec-3b86-4d7c-9f5b-a582d4eb4b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:25.965725 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140efdec-3b86-4d7c-9f5b-a582d4eb4b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:25.967206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140efdec-3b86-4d7c-9f5b-a582d4eb4b45 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:25.984135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 614/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:25.990624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4395b-6d93-49f3-a133-f51d7673bc6d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:26.124857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:26.135184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4395b-6d93-49f3-a133-f51d7673bc6d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:26.177269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe8e7d-a14a-4dc6-84fd-5263e9a800bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:26.177899 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe8e7d-a14a-4dc6-84fd-5263e9a800bf None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:26.178190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe8e7d-a14a-4dc6-84fd-5263e9a800bf None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:26.178481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe8e7d-a14a-4dc6-84fd-5263e9a800bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:26.188332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe8e7d-a14a-4dc6-84fd-5263e9a800bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:26.189971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe8e7d-a14a-4dc6-84fd-5263e9a800bf None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-5cbe8e7d-a14a-4dc6-84fd-5263e9a800bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:13:26.204318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:26.205496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:26.206543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:26.206543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:26.206543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:13:26.206543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:13:26.206543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:13:26.206543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:13:26.206543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:13:26.206543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:13:26.206543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:26.206543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:26.206543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 612/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:26.214931 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140efdec-3b86-4d7c-9f5b-a582d4eb4b45 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:26.275678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:26.344233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140efdec-3b86-4d7c-9f5b-a582d4eb4b45 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:26.387028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6f01e-caf0-44a0-931c-f8dfa6b88ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:26.387737 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6f01e-caf0-44a0-931c-f8dfa6b88ada None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:26.388028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6f01e-caf0-44a0-931c-f8dfa6b88ada None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:26.388306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6f01e-caf0-44a0-931c-f8dfa6b88ada None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:26.389260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6f01e-caf0-44a0-931c-f8dfa6b88ada None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:26.389610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6f01e-caf0-44a0-931c-f8dfa6b88ada None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:26.391296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6f01e-caf0-44a0-931c-f8dfa6b88ada None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:26.413306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 615/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 08:13:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:13:26.420086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe8e7d-a14a-4dc6-84fd-5263e9a800bf None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:26.576247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe8e7d-a14a-4dc6-84fd-5263e9a800bf None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:26.631043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7963-aa5e-4edc-a126-b0ba2b6e4979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:26.632055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7963-aa5e-4edc-a126-b0ba2b6e4979 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:26.632501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7963-aa5e-4edc-a126-b0ba2b6e4979 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:26.632943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7963-aa5e-4edc-a126-b0ba2b6e4979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:26.651407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb7963-aa5e-4edc-a126-b0ba2b6e4979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:26.653893 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb7963-aa5e-4edc-a126-b0ba2b6e4979 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-19bb7963-aa5e-4edc-a126-b0ba2b6e4979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:26.678810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:26.680602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:26.681759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:26.681759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:26.681759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:26.681759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:26.681759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 613/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:26.688172 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6f01e-caf0-44a0-931c-f8dfa6b88ada None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:26.797012 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6f01e-caf0-44a0-931c-f8dfa6b88ada None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:26.799501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:26.835997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a466ad-5244-4818-9d15-fd4a4bd91782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:26.836790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a466ad-5244-4818-9d15-fd4a4bd91782 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:26.836790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a466ad-5244-4818-9d15-fd4a4bd91782 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:26.837263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a466ad-5244-4818-9d15-fd4a4bd91782 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:26.837749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a466ad-5244-4818-9d15-fd4a4bd91782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:26.838117 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a466ad-5244-4818-9d15-fd4a4bd91782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:26.839620 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a466ad-5244-4818-9d15-fd4a4bd91782 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:26.857897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 616/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:26.859183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7963-aa5e-4edc-a126-b0ba2b6e4979 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:26.869815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:26.998219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7963-aa5e-4edc-a126-b0ba2b6e4979 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:27.049061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ac1fd-9fcc-4bf1-9a3b-0b808b49c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:27.049735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac1fd-9fcc-4bf1-9a3b-0b808b49c640 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:27.050129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac1fd-9fcc-4bf1-9a3b-0b808b49c640 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:27.050489 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac1fd-9fcc-4bf1-9a3b-0b808b49c640 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:27.058729 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ac1fd-9fcc-4bf1-9a3b-0b808b49c640 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:27.060267 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ac1fd-9fcc-4bf1-9a3b-0b808b49c640 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-293ac1fd-9fcc-4bf1-9a3b-0b808b49c640 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:13:27.082318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:27.083803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:27.085629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:13:27.085629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:13:27.085629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:13:27.085629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:13:27.085629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:13:27.085629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:13:27.085629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:27.085629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:27.085629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 614/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:13:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:27.094202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a466ad-5244-4818-9d15-fd4a4bd91782 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:27.209200 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a466ad-5244-4818-9d15-fd4a4bd91782 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:27.245517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afe539-976d-46c2-8884-1abae6959f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:27.246274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afe539-976d-46c2-8884-1abae6959f7a None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:27.246458 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afe539-976d-46c2-8884-1abae6959f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:27.246759 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afe539-976d-46c2-8884-1abae6959f7a None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:27.247466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afe539-976d-46c2-8884-1abae6959f7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:27.247790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afe539-976d-46c2-8884-1abae6959f7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:27.249184 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afe539-976d-46c2-8884-1abae6959f7a None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:27.262086 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 617/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:27.268599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ac1fd-9fcc-4bf1-9a3b-0b808b49c640 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:27.367307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:27.417373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ac1fd-9fcc-4bf1-9a3b-0b808b49c640 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:27.461989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb25aca-21f1-4f89-bc65-f5c1c13b88e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:27.462836 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb25aca-21f1-4f89-bc65-f5c1c13b88e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:27.463096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb25aca-21f1-4f89-bc65-f5c1c13b88e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:27.463509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb25aca-21f1-4f89-bc65-f5c1c13b88e8 None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/3318842c46ec4c6d9b7b1f55c9fab62b/roles/64801aebebf743e6b6a4201447a7fe0d` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:27.484439 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb25aca-21f1-4f89-bc65-f5c1c13b88e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=3318842c46ec4c6d9b7b1f55c9fab62b, role_id=64801aebebf743e6b6a4201447a7fe0d)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:27.486215 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb25aca-21f1-4f89-bc65-f5c1c13b88e8 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:27.509072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 615/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:13:27 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/3318842c46ec4c6d9b7b1f55c9fab62b/roles/64801aebebf743e6b6a4201447a7fe0d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:13:29.743179 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97432a7-4e9c-41b5-97d1-6f1124240da1 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:29.743731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97432a7-4e9c-41b5-97d1-6f1124240da1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:29.743731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97432a7-4e9c-41b5-97d1-6f1124240da1 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:29.745099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 618/1233] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:13:29.750824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb908d5-648d-44af-b40f-49a793e43350 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:29.751320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb908d5-648d-44af-b40f-49a793e43350 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:29.751410 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb908d5-648d-44af-b40f-49a793e43350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:29.772509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-ffb908d5-648d-44af-b40f-49a793e43350 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:13:29.774153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ffb908d5-648d-44af-b40f-49a793e43350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:13:29.863097 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 616/1234] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:13:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:13:29.886629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97432a7-4e9c-41b5-97d1-6f1124240da1 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:29.918573 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:30.024449 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97432a7-4e9c-41b5-97d1-6f1124240da1 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:30.075594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9ce30-e97f-4821-857d-e11c1beec8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:30.076486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ce30-e97f-4821-857d-e11c1beec8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:30.076772 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ce30-e97f-4821-857d-e11c1beec8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:30.077047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ce30-e97f-4821-857d-e11c1beec8e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:30.091542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9ce30-e97f-4821-857d-e11c1beec8e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-79c9ce30-e97f-4821-857d-e11c1beec8e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:13:30.097225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:30.098611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:30.099481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 619/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 08:13:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:30.106542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb908d5-648d-44af-b40f-49a793e43350 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:30.169183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:30.240507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb908d5-648d-44af-b40f-49a793e43350 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:30.283303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c84a93-019d-4499-b852-38328109524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:30.283303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84a93-019d-4499-b852-38328109524f None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:30.283303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84a93-019d-4499-b852-38328109524f None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:30.283303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84a93-019d-4499-b852-38328109524f None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:30.283990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c84a93-019d-4499-b852-38328109524f None admin] RBAC: Adding query filter params (name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:30.283990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c84a93-019d-4499-b852-38328109524f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:30.284816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c84a93-019d-4499-b852-38328109524f None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:30.298383 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 617/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 08:13:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:30.304399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9ce30-e97f-4821-857d-e11c1beec8e6 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:30.417081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:30.447027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9ce30-e97f-4821-857d-e11c1beec8e6 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:30.508857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed46fcc-6f60-4f14-9301-3d2c8d5a6b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:30.509890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed46fcc-6f60-4f14-9301-3d2c8d5a6b53 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:30.510401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed46fcc-6f60-4f14-9301-3d2c8d5a6b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:30.510868 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed46fcc-6f60-4f14-9301-3d2c8d5a6b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:30.531533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed46fcc-6f60-4f14-9301-3d2c8d5a6b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:30.533192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed46fcc-6f60-4f14-9301-3d2c8d5a6b53 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-3ed46fcc-6f60-4f14-9301-3d2c8d5a6b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:30.562588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:30.563771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:30.564812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:30.564812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:30.564812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:30.564812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:30.565253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 620/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:30.572915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c84a93-019d-4499-b852-38328109524f None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:30.714465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c84a93-019d-4499-b852-38328109524f None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:30.728597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:30.763684 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ddd0b-7af8-4a1a-a376-54e2f412f8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:30.764679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ddd0b-7af8-4a1a-a376-54e2f412f8df None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:30.765207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ddd0b-7af8-4a1a-a376-54e2f412f8df None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:30.765549 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ddd0b-7af8-4a1a-a376-54e2f412f8df None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:30.766733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ddd0b-7af8-4a1a-a376-54e2f412f8df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:30.768137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ddd0b-7af8-4a1a-a376-54e2f412f8df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:30.771487 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ddd0b-7af8-4a1a-a376-54e2f412f8df None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:30.785992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 618/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:30.796151 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed46fcc-6f60-4f14-9301-3d2c8d5a6b53 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:30.919375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed46fcc-6f60-4f14-9301-3d2c8d5a6b53 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:30.957177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34d4b-aae8-40d9-a01c-2b4858d6fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:30.957954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34d4b-aae8-40d9-a01c-2b4858d6fe98 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:30.958269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34d4b-aae8-40d9-a01c-2b4858d6fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:30.958522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed34d4b-aae8-40d9-a01c-2b4858d6fe98 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:30.962497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:30.968621 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed34d4b-aae8-40d9-a01c-2b4858d6fe98 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:30.970625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed34d4b-aae8-40d9-a01c-2b4858d6fe98 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-9ed34d4b-aae8-40d9-a01c-2b4858d6fe98 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:13:30.985942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:30.987189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:30.988392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:30.988392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:30.988392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:13:30.988392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:13:30.988392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:13:30.988392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:13:30.988392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:13:30.988392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:13:30.988392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:30.988392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:30.991418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 621/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:31.001511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ddd0b-7af8-4a1a-a376-54e2f412f8df None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:31.152104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ddd0b-7af8-4a1a-a376-54e2f412f8df None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:31.209803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8383953-11d6-4ea0-82e3-0b9a1c57195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:31.210506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8383953-11d6-4ea0-82e3-0b9a1c57195d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:31.210798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8383953-11d6-4ea0-82e3-0b9a1c57195d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:31.211108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8383953-11d6-4ea0-82e3-0b9a1c57195d None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:31.211988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8383953-11d6-4ea0-82e3-0b9a1c57195d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:31.212301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8383953-11d6-4ea0-82e3-0b9a1c57195d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:31.213958 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8383953-11d6-4ea0-82e3-0b9a1c57195d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:31.235621 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 619/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 08:13:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:31.242141 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34d4b-aae8-40d9-a01c-2b4858d6fe98 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:31.381261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed34d4b-aae8-40d9-a01c-2b4858d6fe98 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:31.420697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0f588-d528-4cfd-b661-7c98faecdfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:31.421366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0f588-d528-4cfd-b661-7c98faecdfaf None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:31.421671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0f588-d528-4cfd-b661-7c98faecdfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:31.422045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0f588-d528-4cfd-b661-7c98faecdfaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:31.494700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:31.501742 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0f588-d528-4cfd-b661-7c98faecdfaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:31.503285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0f588-d528-4cfd-b661-7c98faecdfaf None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:31.626636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 622/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:13:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:13:31.633565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8383953-11d6-4ea0-82e3-0b9a1c57195d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:31.667948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:31.751171 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8383953-11d6-4ea0-82e3-0b9a1c57195d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:31.794750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8536c71-5b7c-45a1-b4aa-26f6f6a52497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:31.795609 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536c71-5b7c-45a1-b4aa-26f6f6a52497 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:31.795839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536c71-5b7c-45a1-b4aa-26f6f6a52497 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:31.796377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8536c71-5b7c-45a1-b4aa-26f6f6a52497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:31.808245 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8536c71-5b7c-45a1-b4aa-26f6f6a52497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:31.809700 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8536c71-5b7c-45a1-b4aa-26f6f6a52497 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-f8536c71-5b7c-45a1-b4aa-26f6f6a52497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:31.831024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:31.833298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:31.835151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:31.835151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:31.835151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:31.835151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:31.835151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 620/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:31.841131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0f588-d528-4cfd-b661-7c98faecdfaf None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:31.953709 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:31.962147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0f588-d528-4cfd-b661-7c98faecdfaf None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:32.007401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a81b03-afae-4439-9e84-a7bfdc4e8030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:32.008109 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a81b03-afae-4439-9e84-a7bfdc4e8030 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:32.008571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a81b03-afae-4439-9e84-a7bfdc4e8030 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:32.009006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a81b03-afae-4439-9e84-a7bfdc4e8030 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:32.009938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a81b03-afae-4439-9e84-a7bfdc4e8030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:32.010778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a81b03-afae-4439-9e84-a7bfdc4e8030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:32.011917 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a81b03-afae-4439-9e84-a7bfdc4e8030 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:32.025584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 623/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:13:32.036621 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8536c71-5b7c-45a1-b4aa-26f6f6a52497 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:32.139432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:32.165207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8536c71-5b7c-45a1-b4aa-26f6f6a52497 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:32.202610 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc61d7-c508-43a2-8c7a-c8566680ed12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:32.203326 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc61d7-c508-43a2-8c7a-c8566680ed12 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:32.203597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc61d7-c508-43a2-8c7a-c8566680ed12 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:32.204310 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc61d7-c508-43a2-8c7a-c8566680ed12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:32.212273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc61d7-c508-43a2-8c7a-c8566680ed12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:32.213736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc61d7-c508-43a2-8c7a-c8566680ed12 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-c3bc61d7-c508-43a2-8c7a-c8566680ed12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:13:32.228537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:32.229812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:32.231219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:13:32.231219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:13:32.231219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:13:32.231219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:13:32.231219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:13:32.231219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:13:32.231219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:32.231219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:32.231219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 621/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:13:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:32.236187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a81b03-afae-4439-9e84-a7bfdc4e8030 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:32.366324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a81b03-afae-4439-9e84-a7bfdc4e8030 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:32.408524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d2463-442f-4a35-b80d-d6754f657d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:32.409126 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2463-442f-4a35-b80d-d6754f657d53 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:32.409400 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2463-442f-4a35-b80d-d6754f657d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:32.409666 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2463-442f-4a35-b80d-d6754f657d53 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:32.410452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d2463-442f-4a35-b80d-d6754f657d53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:32.410760 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d2463-442f-4a35-b80d-d6754f657d53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:32.412496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d2463-442f-4a35-b80d-d6754f657d53 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:32.425684 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 624/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:13:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:32.433822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc61d7-c508-43a2-8c7a-c8566680ed12 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:32.549860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc61d7-c508-43a2-8c7a-c8566680ed12 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:32.585608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e447be-1e94-400a-b8ae-2bcb927fa3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:32.586304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e447be-1e94-400a-b8ae-2bcb927fa3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:32.586596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e447be-1e94-400a-b8ae-2bcb927fa3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:32.586900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e447be-1e94-400a-b8ae-2bcb927fa3e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:32.587708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e447be-1e94-400a-b8ae-2bcb927fa3e8 None admin] RBAC: Adding query filter params (role.id=64801aebebf743e6b6a4201447a7fe0d, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=3318842c46ec4c6d9b7b1f55c9fab62b) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:32.588024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e447be-1e94-400a-b8ae-2bcb927fa3e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:32.589468 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e447be-1e94-400a-b8ae-2bcb927fa3e8 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:32.596495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 622/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:13:32 2022] GET /identity/v3/role_assignments?user.id=3318842c46ec4c6d9b7b1f55c9fab62b&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=64801aebebf743e6b6a4201447a7fe0d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:34.750689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70790a5f-214a-4e11-84ac-532f4b4faefd None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:34.751260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70790a5f-214a-4e11-84ac-532f4b4faefd None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:34.751260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70790a5f-214a-4e11-84ac-532f4b4faefd None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:34.752548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 625/1247] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:13:34.758588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370599da-73b6-4a15-9f72-01dada00ba13 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:34.759283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370599da-73b6-4a15-9f72-01dada00ba13 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:34.759283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370599da-73b6-4a15-9f72-01dada00ba13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:34.768027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:34.783674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-370599da-73b6-4a15-9f72-01dada00ba13 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:13:34.785161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-370599da-73b6-4a15-9f72-01dada00ba13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:13:34.865613 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 623/1248] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:13:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 08:13:34.890016 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70790a5f-214a-4e11-84ac-532f4b4faefd None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:34.909803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:35.023042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70790a5f-214a-4e11-84ac-532f4b4faefd None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:35.064982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c7743-6da8-4a6b-84b0-f638e02a0f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:35.065758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c7743-6da8-4a6b-84b0-f638e02a0f35 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:35.066093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c7743-6da8-4a6b-84b0-f638e02a0f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:35.066525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c7743-6da8-4a6b-84b0-f638e02a0f35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:35.082934 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c7743-6da8-4a6b-84b0-f638e02a0f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-766c7743-6da8-4a6b-84b0-f638e02a0f35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:13:35.089657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:35.091010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:35.092007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 626/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:13:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:35.099526 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370599da-73b6-4a15-9f72-01dada00ba13 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:35.209648 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370599da-73b6-4a15-9f72-01dada00ba13 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:35.245346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:35.260988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8c1d-bfbf-4677-83b1-260c1eecb2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:35.261903 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8c1d-bfbf-4677-83b1-260c1eecb2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:35.262391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8c1d-bfbf-4677-83b1-260c1eecb2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:35.262786 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8c1d-bfbf-4677-83b1-260c1eecb2f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:35.263747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b8c1d-bfbf-4677-83b1-260c1eecb2f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:35.264142 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b8c1d-bfbf-4677-83b1-260c1eecb2f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:35.265834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b8c1d-bfbf-4677-83b1-260c1eecb2f5 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:35.276851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 624/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:35.283052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c7743-6da8-4a6b-84b0-f638e02a0f35 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:35.386854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:35.424242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c7743-6da8-4a6b-84b0-f638e02a0f35 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:35.470789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022a022-9142-4759-863b-756241f4e722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:35.471693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022a022-9142-4759-863b-756241f4e722 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:35.472020 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022a022-9142-4759-863b-756241f4e722 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:35.472363 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022a022-9142-4759-863b-756241f4e722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:35.488520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022a022-9142-4759-863b-756241f4e722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:35.490673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022a022-9142-4759-863b-756241f4e722 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-2022a022-9142-4759-863b-756241f4e722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:35.509274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:35.510430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:35.511506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:35.511506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:35.511506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:35.511506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:35.511506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 627/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:35.518221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8c1d-bfbf-4677-83b1-260c1eecb2f5 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:35.641135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8c1d-bfbf-4677-83b1-260c1eecb2f5 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:35.682973 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb88e5-56ef-42fa-9413-9456802757b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:35.683742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb88e5-56ef-42fa-9413-9456802757b3 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:35.684097 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb88e5-56ef-42fa-9413-9456802757b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:35.684316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb88e5-56ef-42fa-9413-9456802757b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:35.685162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb88e5-56ef-42fa-9413-9456802757b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:35.685476 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb88e5-56ef-42fa-9413-9456802757b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:35.687299 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb88e5-56ef-42fa-9413-9456802757b3 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:35.701906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 625/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:35.708230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022a022-9142-4759-863b-756241f4e722 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:35.834923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022a022-9142-4759-863b-756241f4e722 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:35.865644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:35.874718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e685dd1-8ad3-48c1-9c9d-a3c601589c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:35.875473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685dd1-8ad3-48c1-9c9d-a3c601589c59 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:35.875771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685dd1-8ad3-48c1-9c9d-a3c601589c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:35.876077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e685dd1-8ad3-48c1-9c9d-a3c601589c59 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:35.889343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e685dd1-8ad3-48c1-9c9d-a3c601589c59 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:35.890832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e685dd1-8ad3-48c1-9c9d-a3c601589c59 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-1e685dd1-8ad3-48c1-9c9d-a3c601589c59 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:13:35.904160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:35.905466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:35.906571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:35.906571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:35.906571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:13:35.906571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:13:35.906571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:13:35.906571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:13:35.906571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:13:35.906571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:13:35.906571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:35.906571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:35.906571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 628/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:35.914906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb88e5-56ef-42fa-9413-9456802757b3 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:35.983600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:36.048298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb88e5-56ef-42fa-9413-9456802757b3 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:36.092594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75f7bf-adcf-4579-8b5b-6f60baa1e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:36.093222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75f7bf-adcf-4579-8b5b-6f60baa1e2cb None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:36.093507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75f7bf-adcf-4579-8b5b-6f60baa1e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:36.093775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75f7bf-adcf-4579-8b5b-6f60baa1e2cb None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:36.094736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75f7bf-adcf-4579-8b5b-6f60baa1e2cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:36.095039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75f7bf-adcf-4579-8b5b-6f60baa1e2cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:36.096507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df75f7bf-adcf-4579-8b5b-6f60baa1e2cb None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:36.125448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 626/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 08:13:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:36.127089 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e685dd1-8ad3-48c1-9c9d-a3c601589c59 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:36.256553 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e685dd1-8ad3-48c1-9c9d-a3c601589c59 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:36.296504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fdff1-aced-4d12-a341-85bd5dcad561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:36.297134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fdff1-aced-4d12-a341-85bd5dcad561 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:36.297419 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fdff1-aced-4d12-a341-85bd5dcad561 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:36.297694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fdff1-aced-4d12-a341-85bd5dcad561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:36.365015 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:36.379604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fdff1-aced-4d12-a341-85bd5dcad561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:36.381116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fdff1-aced-4d12-a341-85bd5dcad561 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:36.498647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 629/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:13:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:13:36.504905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75f7bf-adcf-4579-8b5b-6f60baa1e2cb None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:36.643876 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75f7bf-adcf-4579-8b5b-6f60baa1e2cb None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:36.665002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:36.695120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c13d-4e53-43da-b053-b0eb4fda888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:36.695805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c13d-4e53-43da-b053-b0eb4fda888d None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:36.699671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c13d-4e53-43da-b053-b0eb4fda888d None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:36.699671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c13d-4e53-43da-b053-b0eb4fda888d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:36.708127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c13d-4e53-43da-b053-b0eb4fda888d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:36.709587 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c13d-4e53-43da-b053-b0eb4fda888d None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-a740c13d-4e53-43da-b053-b0eb4fda888d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:36.725160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:36.726304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:36.728161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:36.728161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:36.728161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:36.728161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:36.728161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 627/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:36.732720 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fdff1-aced-4d12-a341-85bd5dcad561 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:36.836995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:36.854391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fdff1-aced-4d12-a341-85bd5dcad561 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:36.902427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037add38-91b2-4340-bccc-178a3e92f5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:36.903078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037add38-91b2-4340-bccc-178a3e92f5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:36.903470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037add38-91b2-4340-bccc-178a3e92f5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:36.903841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037add38-91b2-4340-bccc-178a3e92f5c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:36.904595 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037add38-91b2-4340-bccc-178a3e92f5c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:36.904901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037add38-91b2-4340-bccc-178a3e92f5c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:36.906318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037add38-91b2-4340-bccc-178a3e92f5c0 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:36.921025 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 630/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:36.927088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c13d-4e53-43da-b053-b0eb4fda888d None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:37.073077 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c13d-4e53-43da-b053-b0eb4fda888d None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:37.121522 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdeefc-2021-463b-8588-3acb0c66a5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:37.122184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdeefc-2021-463b-8588-3acb0c66a5fb None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:37.122463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdeefc-2021-463b-8588-3acb0c66a5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:37.122738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdeefc-2021-463b-8588-3acb0c66a5fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:37.130885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdeefc-2021-463b-8588-3acb0c66a5fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:37.132342 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bdeefc-2021-463b-8588-3acb0c66a5fb None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-d9bdeefc-2021-463b-8588-3acb0c66a5fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:13:37.144540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:37.146386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:37.147888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:13:37.147888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:13:37.147888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:13:37.147888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:13:37.147888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:13:37.147888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:13:37.147888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:37.147888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:37.147888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 628/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:37.153052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037add38-91b2-4340-bccc-178a3e92f5c0 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:37.272119 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037add38-91b2-4340-bccc-178a3e92f5c0 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:37.315347 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6109aa-7f93-4de3-b22a-b54bec57fa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:37.315981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6109aa-7f93-4de3-b22a-b54bec57fa50 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:37.316263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6109aa-7f93-4de3-b22a-b54bec57fa50 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:37.316536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6109aa-7f93-4de3-b22a-b54bec57fa50 None admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:37.317338 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6109aa-7f93-4de3-b22a-b54bec57fa50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:37.317657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6109aa-7f93-4de3-b22a-b54bec57fa50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:37.319226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6109aa-7f93-4de3-b22a-b54bec57fa50 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:37.332712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 631/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:13:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:37.339888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdeefc-2021-463b-8588-3acb0c66a5fb None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:37.373246 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:37.477597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdeefc-2021-463b-8588-3acb0c66a5fb None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:37.515745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2490727-557b-4fa0-8b98-b999632afccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:37.516401 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2490727-557b-4fa0-8b98-b999632afccc None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:37.516707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2490727-557b-4fa0-8b98-b999632afccc None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:37.517003 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2490727-557b-4fa0-8b98-b999632afccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:37.517823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2490727-557b-4fa0-8b98-b999632afccc None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=3318842c46ec4c6d9b7b1f55c9fab62b) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:37.518189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2490727-557b-4fa0-8b98-b999632afccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:37.519668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2490727-557b-4fa0-8b98-b999632afccc None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:37.526726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 629/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:13:37 2022] GET /identity/v3/role_assignments?user.id=3318842c46ec4c6d9b7b1f55c9fab62b&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:39.687235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae2a6-19a4-4bc8-96cc-32a6540d0c15 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:39.687819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae2a6-19a4-4bc8-96cc-32a6540d0c15 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:39.687819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fae2a6-19a4-4bc8-96cc-32a6540d0c15 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:39.689135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 632/1261] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:13:39.694991 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83282-0b7b-44a2-b4d8-cf6dff313367 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:39.696015 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83282-0b7b-44a2-b4d8-cf6dff313367 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:39.696117 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83282-0b7b-44a2-b4d8-cf6dff313367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:39.717983 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-61e83282-0b7b-44a2-b4d8-cf6dff313367 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:13:39.719149 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-61e83282-0b7b-44a2-b4d8-cf6dff313367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:13:39.798479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 630/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:13:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:13:39.825847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fae2a6-19a4-4bc8-96cc-32a6540d0c15 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:39.837780 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:39.977614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fae2a6-19a4-4bc8-96cc-32a6540d0c15 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:40.021670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660435e-c7c1-42d1-b799-b8f1d2e7edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:40.022541 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660435e-c7c1-42d1-b799-b8f1d2e7edee None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:40.022877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660435e-c7c1-42d1-b799-b8f1d2e7edee None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:40.023169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660435e-c7c1-42d1-b799-b8f1d2e7edee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:40.037952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660435e-c7c1-42d1-b799-b8f1d2e7edee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-c660435e-c7c1-42d1-b799-b8f1d2e7edee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:13:40.044608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:40.045745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:40.047008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 633/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 08:13:40.053409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83282-0b7b-44a2-b4d8-cf6dff313367 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:40.074337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:40.157265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83282-0b7b-44a2-b4d8-cf6dff313367 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:40.192856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804eb63-cf66-4f6c-ab73-c2ad936a8565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:40.193474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804eb63-cf66-4f6c-ab73-c2ad936a8565 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:40.193755 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804eb63-cf66-4f6c-ab73-c2ad936a8565 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:40.194058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804eb63-cf66-4f6c-ab73-c2ad936a8565 None admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:40.194781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804eb63-cf66-4f6c-ab73-c2ad936a8565 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:40.195143 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804eb63-cf66-4f6c-ab73-c2ad936a8565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:40.197010 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804eb63-cf66-4f6c-ab73-c2ad936a8565 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:40.205666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 631/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:40.211480 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660435e-c7c1-42d1-b799-b8f1d2e7edee None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:40.287174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:40.321898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660435e-c7c1-42d1-b799-b8f1d2e7edee None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:40.360873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116b3ef-09aa-4eed-b1eb-c9759f7671d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:40.361531 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116b3ef-09aa-4eed-b1eb-c9759f7671d2 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:40.361807 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116b3ef-09aa-4eed-b1eb-c9759f7671d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:40.362114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116b3ef-09aa-4eed-b1eb-c9759f7671d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:40.373960 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116b3ef-09aa-4eed-b1eb-c9759f7671d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:40.375500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116b3ef-09aa-4eed-b1eb-c9759f7671d2 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-b116b3ef-09aa-4eed-b1eb-c9759f7671d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:40.390715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:40.391840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:40.392967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:40.392967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:40.392967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:40.392967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:40.392967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 634/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:40.397753 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804eb63-cf66-4f6c-ab73-c2ad936a8565 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:40.486884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:40.507246 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804eb63-cf66-4f6c-ab73-c2ad936a8565 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:40.541400 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23a0dc-e0d1-402b-ba81-852492de14d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:40.541929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a0dc-e0d1-402b-ba81-852492de14d4 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:40.542267 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a0dc-e0d1-402b-ba81-852492de14d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:40.542543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23a0dc-e0d1-402b-ba81-852492de14d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:40.543232 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23a0dc-e0d1-402b-ba81-852492de14d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:40.543539 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23a0dc-e0d1-402b-ba81-852492de14d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:40.544908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23a0dc-e0d1-402b-ba81-852492de14d4 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:40.557697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 632/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:40.563456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116b3ef-09aa-4eed-b1eb-c9759f7671d2 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:40.663356 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116b3ef-09aa-4eed-b1eb-c9759f7671d2 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:40.684089 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:40.698225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3086c-79cd-4ba4-9273-d3ef82e41742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:40.698892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3086c-79cd-4ba4-9273-d3ef82e41742 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:40.699133 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3086c-79cd-4ba4-9273-d3ef82e41742 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:40.699411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3086c-79cd-4ba4-9273-d3ef82e41742 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:40.708127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3086c-79cd-4ba4-9273-d3ef82e41742 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:40.709575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3086c-79cd-4ba4-9273-d3ef82e41742 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-eab3086c-79cd-4ba4-9273-d3ef82e41742 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:13:40.722001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:40.723745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:40.725471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:40.725471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:40.725471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:13:40.725471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:13:40.725471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:13:40.725471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:13:40.725471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:13:40.725471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:13:40.725471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:40.725471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:40.725471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 635/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:40.729578 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23a0dc-e0d1-402b-ba81-852492de14d4 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:40.841339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23a0dc-e0d1-402b-ba81-852492de14d4 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:40.876677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5db37-2f27-455e-b057-47c42949c155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:40.877302 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5db37-2f27-455e-b057-47c42949c155 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:40.877585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5db37-2f27-455e-b057-47c42949c155 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:40.877862 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5db37-2f27-455e-b057-47c42949c155 None admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:40.878691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5db37-2f27-455e-b057-47c42949c155 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:40.879005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5db37-2f27-455e-b057-47c42949c155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:40.880438 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5db37-2f27-455e-b057-47c42949c155 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:40.889538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:40.899605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 633/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 08:13:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:40.905416 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3086c-79cd-4ba4-9273-d3ef82e41742 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:41.017825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3086c-79cd-4ba4-9273-d3ef82e41742 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:41.053801 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358b8be-c8e4-4f46-a0a8-bb8f4a01f60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:41.054513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b8be-c8e4-4f46-a0a8-bb8f4a01f60c None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:41.054790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b8be-c8e4-4f46-a0a8-bb8f4a01f60c None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:41.055062 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b8be-c8e4-4f46-a0a8-bb8f4a01f60c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:41.065531 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358b8be-c8e4-4f46-a0a8-bb8f4a01f60c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:41.067002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358b8be-c8e4-4f46-a0a8-bb8f4a01f60c None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-f358b8be-c8e4-4f46-a0a8-bb8f4a01f60c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:41.081790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:41.082965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:41.083918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:41.083918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:41.083918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:41.083918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:41.083918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 636/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:41.089828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5db37-2f27-455e-b057-47c42949c155 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:41.191178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5db37-2f27-455e-b057-47c42949c155 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:41.227103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a0c00-15b2-408c-8f1e-a05856df6003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:41.227727 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a0c00-15b2-408c-8f1e-a05856df6003 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:41.228017 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a0c00-15b2-408c-8f1e-a05856df6003 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:41.228296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a0c00-15b2-408c-8f1e-a05856df6003 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:41.228986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a0c00-15b2-408c-8f1e-a05856df6003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:41.229295 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a0c00-15b2-408c-8f1e-a05856df6003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:41.230710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a0c00-15b2-408c-8f1e-a05856df6003 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:41.242587 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 634/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:41.248351 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358b8be-c8e4-4f46-a0a8-bb8f4a01f60c None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:41.283063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:41.353283 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358b8be-c8e4-4f46-a0a8-bb8f4a01f60c None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:41.387274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aca45-f430-4790-bfb5-c6739646f5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:41.387920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aca45-f430-4790-bfb5-c6739646f5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:41.388199 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aca45-f430-4790-bfb5-c6739646f5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:41.388473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909aca45-f430-4790-bfb5-c6739646f5f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:41.396570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aca45-f430-4790-bfb5-c6739646f5f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:41.398045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909aca45-f430-4790-bfb5-c6739646f5f8 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-909aca45-f430-4790-bfb5-c6739646f5f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:13:41.410344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:41.411444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:41.413105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:13:41.413105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:13:41.413105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:13:41.413105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:13:41.413105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:13:41.413105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:13:41.413105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:41.413105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:41.413105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 637/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:41.417686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a0c00-15b2-408c-8f1e-a05856df6003 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:41.476170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:41.518148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a0c00-15b2-408c-8f1e-a05856df6003 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:41.551280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3c0df-f7ba-42dc-843b-4f4d3d956a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:41.551894 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c0df-f7ba-42dc-843b-4f4d3d956a01 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:41.552173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c0df-f7ba-42dc-843b-4f4d3d956a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:41.552502 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c0df-f7ba-42dc-843b-4f4d3d956a01 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:41.553192 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3c0df-f7ba-42dc-843b-4f4d3d956a01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:41.553497 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3c0df-f7ba-42dc-843b-4f4d3d956a01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:41.555463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3c0df-f7ba-42dc-843b-4f4d3d956a01 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:41.567705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 635/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:41.575371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aca45-f430-4790-bfb5-c6739646f5f8 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:41.672589 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:41.682486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909aca45-f430-4790-bfb5-c6739646f5f8 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:41.716594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9d4ee-805e-4b27-8e32-2e441fdda7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:41.717263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d4ee-805e-4b27-8e32-2e441fdda7ba None admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:41.717633 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d4ee-805e-4b27-8e32-2e441fdda7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:41.717910 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9d4ee-805e-4b27-8e32-2e441fdda7ba None admin] PATH_INFO: `/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/3318842c46ec4c6d9b7b1f55c9fab62b/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:41.719966 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9d4ee-805e-4b27-8e32-2e441fdda7ba None admin] RBAC: Authorizing `identity:create_grant(project_id=d4bf48158ec549ecb880530a3b4ff229, user_id=3318842c46ec4c6d9b7b1f55c9fab62b, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:41.721394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9d4ee-805e-4b27-8e32-2e441fdda7ba None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:41.734935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 638/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 08:13:41 2022] PUT /identity/v3/projects/d4bf48158ec549ecb880530a3b4ff229/users/3318842c46ec4c6d9b7b1f55c9fab62b/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:13:43.753906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f90fb-9876-4023-ab9a-8b87a8222929 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:43.754466 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f90fb-9876-4023-ab9a-8b87a8222929 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:43.754560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f90fb-9876-4023-ab9a-8b87a8222929 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:43.755854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 636/1274] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:13:43.761583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2556c2-7ef6-47be-8f31-bace1b05d65f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:43.761975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2556c2-7ef6-47be-8f31-bace1b05d65f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:43.762166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2556c2-7ef6-47be-8f31-bace1b05d65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:43.780263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3f2556c2-7ef6-47be-8f31-bace1b05d65f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:13:43.781478 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3f2556c2-7ef6-47be-8f31-bace1b05d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:13:43.848453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 639/1275] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:13:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:13:43.872123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f90fb-9876-4023-ab9a-8b87a8222929 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:43.972762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f90fb-9876-4023-ab9a-8b87a8222929 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:43.990988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:44.011780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f653c5-b7a2-4749-a0c3-917d337f993c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:44.012414 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f653c5-b7a2-4749-a0c3-917d337f993c None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:44.012701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f653c5-b7a2-4749-a0c3-917d337f993c None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:44.012984 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f653c5-b7a2-4749-a0c3-917d337f993c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:44.024541 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f653c5-b7a2-4749-a0c3-917d337f993c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-33f653c5-b7a2-4749-a0c3-917d337f993c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 08:13:44.029475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:44.030512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:44.031771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 637/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 08:13:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:44.037574 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2556c2-7ef6-47be-8f31-bace1b05d65f None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:44.120753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:44.140172 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2556c2-7ef6-47be-8f31-bace1b05d65f None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:44.175544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dbc94-6375-4c8b-a942-f142b045fe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:44.176159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dbc94-6375-4c8b-a942-f142b045fe72 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:44.176435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dbc94-6375-4c8b-a942-f142b045fe72 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:44.176706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489dbc94-6375-4c8b-a942-f142b045fe72 None admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:44.177419 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dbc94-6375-4c8b-a942-f142b045fe72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:44.177721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dbc94-6375-4c8b-a942-f142b045fe72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:44.179122 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489dbc94-6375-4c8b-a942-f142b045fe72 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:44.187856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 640/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 08:13:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:44.193641 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f653c5-b7a2-4749-a0c3-917d337f993c None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:44.298711 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f653c5-b7a2-4749-a0c3-917d337f993c None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:44.333312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22007a4b-511d-4ad2-908c-2cc3b1e42107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:44.333957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007a4b-511d-4ad2-908c-2cc3b1e42107 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:44.334269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007a4b-511d-4ad2-908c-2cc3b1e42107 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:44.334547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22007a4b-511d-4ad2-908c-2cc3b1e42107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:44.345490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22007a4b-511d-4ad2-908c-2cc3b1e42107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:44.346970 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22007a4b-511d-4ad2-908c-2cc3b1e42107 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-22007a4b-511d-4ad2-908c-2cc3b1e42107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:44.362308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:44.363369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:44.364718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:44.364718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:44.364718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:44.364718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:44.364718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 638/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:44.370186 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dbc94-6375-4c8b-a942-f142b045fe72 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:44.468955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489dbc94-6375-4c8b-a942-f142b045fe72 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:44.504869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ffab-afeb-41dd-aeb3-3974139d7a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:44.505485 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ffab-afeb-41dd-aeb3-3974139d7a5e None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:44.505766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ffab-afeb-41dd-aeb3-3974139d7a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:44.506066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ffab-afeb-41dd-aeb3-3974139d7a5e None admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:44.506761 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8ffab-afeb-41dd-aeb3-3974139d7a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:44.507066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8ffab-afeb-41dd-aeb3-3974139d7a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:44.508414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8ffab-afeb-41dd-aeb3-3974139d7a5e None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:44.520348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 641/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:44.526620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22007a4b-511d-4ad2-908c-2cc3b1e42107 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:44.559784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:44.637626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22007a4b-511d-4ad2-908c-2cc3b1e42107 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:44.671720 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f2127-7ba0-41d3-b9e8-4e48f7879816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:44.672364 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2127-7ba0-41d3-b9e8-4e48f7879816 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:44.672652 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2127-7ba0-41d3-b9e8-4e48f7879816 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:44.672926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2127-7ba0-41d3-b9e8-4e48f7879816 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:44.681389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f2127-7ba0-41d3-b9e8-4e48f7879816 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:44.682857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f2127-7ba0-41d3-b9e8-4e48f7879816 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-d72f2127-7ba0-41d3-b9e8-4e48f7879816 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 08:13:44.694138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:44.698829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:44.700053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:44.700053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:44.700053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 08:13:44.700053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 08:13:44.700053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 08:13:44.700053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 08:13:44.700053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 08:13:44.700053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 08:13:44.700053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 08:13:44.700053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:44.700053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 639/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:44.702057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ffab-afeb-41dd-aeb3-3974139d7a5e None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:44.705850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:44.808174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ffab-afeb-41dd-aeb3-3974139d7a5e None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:44.842279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec9ce-594b-474f-8633-b468c0b72766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:44.842817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec9ce-594b-474f-8633-b468c0b72766 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:44.843098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec9ce-594b-474f-8633-b468c0b72766 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:44.843375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec9ce-594b-474f-8633-b468c0b72766 None admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:44.844172 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddec9ce-594b-474f-8633-b468c0b72766 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:44.844480 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddec9ce-594b-474f-8633-b468c0b72766 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:44.845997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddec9ce-594b-474f-8633-b468c0b72766 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:44.864238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 642/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 08:13:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:44.870795 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f2127-7ba0-41d3-b9e8-4e48f7879816 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:44.961218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:44.971219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f2127-7ba0-41d3-b9e8-4e48f7879816 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:45.008793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b742336-ddd1-427b-ae8c-f5efedb5e958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:45.009415 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b742336-ddd1-427b-ae8c-f5efedb5e958 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:45.009695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b742336-ddd1-427b-ae8c-f5efedb5e958 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:45.009971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b742336-ddd1-427b-ae8c-f5efedb5e958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:45.081189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b742336-ddd1-427b-ae8c-f5efedb5e958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:45.082665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b742336-ddd1-427b-ae8c-f5efedb5e958 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:45.176253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:45.187074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 640/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 08:13:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 08:13:45.193017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec9ce-594b-474f-8633-b468c0b72766 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:45.254950 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:45.307797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec9ce-594b-474f-8633-b468c0b72766 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:45.341828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a06406-e0dc-4234-9ae9-a2534f480973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:45.342503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06406-e0dc-4234-9ae9-a2534f480973 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:45.342777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06406-e0dc-4234-9ae9-a2534f480973 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:45.343312 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06406-e0dc-4234-9ae9-a2534f480973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:45.354493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a06406-e0dc-4234-9ae9-a2534f480973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:45.355932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a06406-e0dc-4234-9ae9-a2534f480973 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-f9a06406-e0dc-4234-9ae9-a2534f480973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 08:13:45.370905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:45.372069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:45.373211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 08:13:45.373211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 08:13:45.373211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 08:13:45.373211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:45.373211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 643/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:45.378102 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b742336-ddd1-427b-ae8c-f5efedb5e958 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:45.480073 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b742336-ddd1-427b-ae8c-f5efedb5e958 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:45.513759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aeb81-24b1-41ef-b1f4-afc1cb0c8c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:45.514580 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aeb81-24b1-41ef-b1f4-afc1cb0c8c18 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:45.514868 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aeb81-24b1-41ef-b1f4-afc1cb0c8c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:45.515153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aeb81-24b1-41ef-b1f4-afc1cb0c8c18 None admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:45.515846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45aeb81-24b1-41ef-b1f4-afc1cb0c8c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:45.516153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45aeb81-24b1-41ef-b1f4-afc1cb0c8c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:45.517524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45aeb81-24b1-41ef-b1f4-afc1cb0c8c18 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:45.529523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 641/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 08:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:45.535307 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a06406-e0dc-4234-9ae9-a2534f480973 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:45.637842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a06406-e0dc-4234-9ae9-a2534f480973 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:45.652236 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:45.674414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2dfe3-0648-464d-813f-de1a63ba67ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:45.675060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2dfe3-0648-464d-813f-de1a63ba67ac None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:45.675347 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2dfe3-0648-464d-813f-de1a63ba67ac None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:45.675614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2dfe3-0648-464d-813f-de1a63ba67ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:45.682445 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2dfe3-0648-464d-813f-de1a63ba67ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:45.683904 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2dfe3-0648-464d-813f-de1a63ba67ac None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application [None req-49a2dfe3-0648-464d-813f-de1a63ba67ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 08:13:45.696812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:45.697903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:45.698923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 08:13:45.698923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 08:13:45.698923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 08:13:45.698923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 08:13:45.698923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 08:13:45.698923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 08:13:45.698923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 08:13:45.698923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: ERROR keystone.server.flask.application Aug 02 08:13:45.698923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 644/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 08:13:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:45.704047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aeb81-24b1-41ef-b1f4-afc1cb0c8c18 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:45.754768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:45.806319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aeb81-24b1-41ef-b1f4-afc1cb0c8c18 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:45.840278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0f25e-1bb1-4dd3-a8f9-69b8cc8a7391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:45.840904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0f25e-1bb1-4dd3-a8f9-69b8cc8a7391 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:45.841192 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0f25e-1bb1-4dd3-a8f9-69b8cc8a7391 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:45.841470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0f25e-1bb1-4dd3-a8f9-69b8cc8a7391 None admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:45.842270 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0f25e-1bb1-4dd3-a8f9-69b8cc8a7391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:45.842584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0f25e-1bb1-4dd3-a8f9-69b8cc8a7391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:45.844019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0f25e-1bb1-4dd3-a8f9-69b8cc8a7391 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:45.856665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 642/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 08:13:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:45.862820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2dfe3-0648-464d-813f-de1a63ba67ac None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:45.961177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2dfe3-0648-464d-813f-de1a63ba67ac None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:46.001362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c450a2-44f7-4c46-a31e-0d85cc311795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:46.002603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c450a2-44f7-4c46-a31e-0d85cc311795 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:46.003268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c450a2-44f7-4c46-a31e-0d85cc311795 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:46.003763 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c450a2-44f7-4c46-a31e-0d85cc311795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:46.004613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c450a2-44f7-4c46-a31e-0d85cc311795 None admin] RBAC: Adding query filter params (role.id=833033b33b864ee4acbf46f69ad82dc3, scope.project.id=d4bf48158ec549ecb880530a3b4ff229, user.id=3318842c46ec4c6d9b7b1f55c9fab62b) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:46.005016 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c450a2-44f7-4c46-a31e-0d85cc311795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:46.006508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c450a2-44f7-4c46-a31e-0d85cc311795 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:46.013501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 645/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 08:13:45 2022] GET /identity/v3/role_assignments?user.id=3318842c46ec4c6d9b7b1f55c9fab62b&scope.project.id=d4bf48158ec549ecb880530a3b4ff229&role.id=833033b33b864ee4acbf46f69ad82dc3 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:48.058947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d161a6c-f849-48e2-8a42-dd52fd16398f None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:48.059497 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d161a6c-f849-48e2-8a42-dd52fd16398f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:48.059615 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d161a6c-f849-48e2-8a42-dd52fd16398f None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:48.060988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 643/1288] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:13:48.066530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d2158-0423-409e-a091-3604edaefeb7 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:48.066990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d2158-0423-409e-a091-3604edaefeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:48.067081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d2158-0423-409e-a091-3604edaefeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:48.086688 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-830d2158-0423-409e-a091-3604edaefeb7 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:13:48.087898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-830d2158-0423-409e-a091-3604edaefeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:13:48.119851 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:48.159111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 646/1289] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:13:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:13:48.181753 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d161a6c-f849-48e2-8a42-dd52fd16398f None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:48.283441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d161a6c-f849-48e2-8a42-dd52fd16398f None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:48.295495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:48.319568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c398-c3a3-4c5b-878a-58f54f5119e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:48.320156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c398-c3a3-4c5b-878a-58f54f5119e8 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:48.320424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c398-c3a3-4c5b-878a-58f54f5119e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:48.320692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c398-c3a3-4c5b-878a-58f54f5119e8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:48.321353 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9c398-c3a3-4c5b-878a-58f54f5119e8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:48.322739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9c398-c3a3-4c5b-878a-58f54f5119e8 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-90a9c398-c3a3-4c5b-878a-58f54f5119e8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:48.332750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:48.334083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:48.335051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 644/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 08:13:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:48.340818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d2158-0423-409e-a091-3604edaefeb7 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:48.452920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d2158-0423-409e-a091-3604edaefeb7 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:48.488229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08ab25-e8ef-46f5-ae45-9d70472a06df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:48.488846 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ab25-e8ef-46f5-ae45-9d70472a06df None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:48.489122 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ab25-e8ef-46f5-ae45-9d70472a06df None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:48.489393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08ab25-e8ef-46f5-ae45-9d70472a06df None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:48.490099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08ab25-e8ef-46f5-ae45-9d70472a06df None admin] RBAC: Adding query filter params (name=placement) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:48.490402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08ab25-e8ef-46f5-ae45-9d70472a06df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:48.491761 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08ab25-e8ef-46f5-ae45-9d70472a06df None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:48.496767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 647/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 2 08:13:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:48.502951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c398-c3a3-4c5b-878a-58f54f5119e8 None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:48.609238 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c398-c3a3-4c5b-878a-58f54f5119e8 None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:48.643629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964c464-2667-4922-92eb-cef7425057c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:48.644255 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964c464-2667-4922-92eb-cef7425057c9 None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:48.644534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964c464-2667-4922-92eb-cef7425057c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:48.644811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964c464-2667-4922-92eb-cef7425057c9 None admin] PATH_INFO: `/v3/services` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:48.645493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964c464-2667-4922-92eb-cef7425057c9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:48.645804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964c464-2667-4922-92eb-cef7425057c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:48.647191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964c464-2667-4922-92eb-cef7425057c9 None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:48.652480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 645/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 2 08:13:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:50.690421 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4554af-cf3c-412c-a65d-f41e4e8cc70b None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:50.691027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4554af-cf3c-412c-a65d-f41e4e8cc70b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:50.691027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4554af-cf3c-412c-a65d-f41e4e8cc70b None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:50.692316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 648/1293] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:13:50.698224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ecf5-ecce-4491-9a40-023496d7ad64 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:50.698659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ecf5-ecce-4491-9a40-023496d7ad64 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:50.698792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ecf5-ecce-4491-9a40-023496d7ad64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:50.716900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-b8b6ecf5-ecce-4491-9a40-023496d7ad64 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:13:50.718187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b8b6ecf5-ecce-4491-9a40-023496d7ad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:13:50.747742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:50.785476 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 646/1294] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:13:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:13:50.809087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4554af-cf3c-412c-a65d-f41e4e8cc70b None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:50.839195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:50.910675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4554af-cf3c-412c-a65d-f41e4e8cc70b None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:50.945101 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06528a90-3927-40f4-a0dd-b3cfda4f57d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:50.945632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06528a90-3927-40f4-a0dd-b3cfda4f57d3 None admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:50.945908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06528a90-3927-40f4-a0dd-b3cfda4f57d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:50.946204 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06528a90-3927-40f4-a0dd-b3cfda4f57d3 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:50.946905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06528a90-3927-40f4-a0dd-b3cfda4f57d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:50.948253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06528a90-3927-40f4-a0dd-b3cfda4f57d3 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:50.962774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 649/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 08:13:50 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:13:53.013854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19571d3f-ae76-4d13-b7ed-f1d8fa861474 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:53.014420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19571d3f-ae76-4d13-b7ed-f1d8fa861474 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:53.014508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19571d3f-ae76-4d13-b7ed-f1d8fa861474 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:53.015815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 647/1296] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:13:53.021228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff2b25-a3c9-40d4-99ff-9878d37f3e9e None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:53.021738 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff2b25-a3c9-40d4-99ff-9878d37f3e9e None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:53.021835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff2b25-a3c9-40d4-99ff-9878d37f3e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:53.041978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-0dff2b25-a3c9-40d4-99ff-9878d37f3e9e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:13:53.042635 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0dff2b25-a3c9-40d4-99ff-9878d37f3e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:13:53.118149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 650/1297] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:13:53 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:13:53.140629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19571d3f-ae76-4d13-b7ed-f1d8fa861474 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:53.246312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19571d3f-ae76-4d13-b7ed-f1d8fa861474 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:53.282147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fd2ed-2223-4992-9912-9854243f783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:53.282708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fd2ed-2223-4992-9912-9854243f783a None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:53.282990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fd2ed-2223-4992-9912-9854243f783a None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:53.283262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fd2ed-2223-4992-9912-9854243f783a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:53.283891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fd2ed-2223-4992-9912-9854243f783a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:53.285272 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0fd2ed-2223-4992-9912-9854243f783a None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-fc0fd2ed-2223-4992-9912-9854243f783a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:53.294697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:53.295968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:53.297125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 648/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 08:13:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:53.303341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff2b25-a3c9-40d4-99ff-9878d37f3e9e None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:53.325373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:53.416737 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff2b25-a3c9-40d4-99ff-9878d37f3e9e None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:53.452262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad5df-7b17-44c9-87c3-8208558f03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:53.452882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad5df-7b17-44c9-87c3-8208558f03f2 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:53.453205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad5df-7b17-44c9-87c3-8208558f03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:53.453431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cad5df-7b17-44c9-87c3-8208558f03f2 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:53.454137 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad5df-7b17-44c9-87c3-8208558f03f2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:53.454440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad5df-7b17-44c9-87c3-8208558f03f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:53.455801 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cad5df-7b17-44c9-87c3-8208558f03f2 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:53.461031 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 651/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 2 08:13:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:53.467224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fd2ed-2223-4992-9912-9854243f783a None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:53.511403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:53.581437 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0fd2ed-2223-4992-9912-9854243f783a None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:53.624695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bd4af-a5d9-4126-a2af-a67da467ce0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:53.625509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd4af-a5d9-4126-a2af-a67da467ce0e None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:53.625999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd4af-a5d9-4126-a2af-a67da467ce0e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:53.626546 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bd4af-a5d9-4126-a2af-a67da467ce0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:53.627791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd4af-a5d9-4126-a2af-a67da467ce0e None admin] RBAC: Adding query filter params (interface=public, service_id=12582e0248aa42c4b074a4996531f97f, region_id=RegionOne) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:53.628341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd4af-a5d9-4126-a2af-a67da467ce0e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:53.630928 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4bd4af-a5d9-4126-a2af-a67da467ce0e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:53.638611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 649/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 08:13:53 2022] GET /identity/v3/endpoints?service_id=12582e0248aa42c4b074a4996531f97f&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:13:53.644471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad5df-7b17-44c9-87c3-8208558f03f2 None admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:53.736553 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:53.755641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cad5df-7b17-44c9-87c3-8208558f03f2 None admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:53.790866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72187a43-26c2-4844-90d2-979e0bbd4308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:53.791486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72187a43-26c2-4844-90d2-979e0bbd4308 None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:53.791765 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72187a43-26c2-4844-90d2-979e0bbd4308 None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:53.792041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72187a43-26c2-4844-90d2-979e0bbd4308 None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:53.792699 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72187a43-26c2-4844-90d2-979e0bbd4308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:53.794084 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72187a43-26c2-4844-90d2-979e0bbd4308 None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:53.801131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 652/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 08:13:53 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:13:55.829666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fb7d0-4944-4799-a605-40cb5624f431 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:55.830235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fb7d0-4944-4799-a605-40cb5624f431 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:55.830235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fb7d0-4944-4799-a605-40cb5624f431 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:55.831602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 650/1302] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:13:55.837447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f09f7-987b-4b45-99e4-c95f939d19fe None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:55.837923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f09f7-987b-4b45-99e4-c95f939d19fe None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:55.838052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f09f7-987b-4b45-99e4-c95f939d19fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:55.857224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-130f09f7-987b-4b45-99e4-c95f939d19fe None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:13:55.858607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-130f09f7-987b-4b45-99e4-c95f939d19fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:13:55.924650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 653/1303] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:13:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 08:13:55.946943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fb7d0-4944-4799-a605-40cb5624f431 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:56.051407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:56.058288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fb7d0-4944-4799-a605-40cb5624f431 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:56.095630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6a1f5-b261-450e-8c25-4105a793717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:56.096181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6a1f5-b261-450e-8c25-4105a793717b None admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:56.096459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6a1f5-b261-450e-8c25-4105a793717b None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:56.096729 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6a1f5-b261-450e-8c25-4105a793717b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:56.097355 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6a1f5-b261-450e-8c25-4105a793717b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:56.098746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6a1f5-b261-450e-8c25-4105a793717b None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application [None req-50f6a1f5-b261-450e-8c25-4105a793717b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 08:13:56.107785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 08:13:56.113944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application with Lock( Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self._enter() Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application return self.creator() Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application created_value = creator( Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: ERROR keystone.server.flask.application Aug 02 08:13:56.115374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 651/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 08:13:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 08:13:56.120938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f09f7-987b-4b45-99e4-c95f939d19fe None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:56.202302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:13:56.226195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f09f7-987b-4b45-99e4-c95f939d19fe None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:56.259773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53603421-f894-40a4-94d1-f128d4404f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:56.260398 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53603421-f894-40a4-94d1-f128d4404f9d None admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:56.260677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53603421-f894-40a4-94d1-f128d4404f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:56.260953 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53603421-f894-40a4-94d1-f128d4404f9d None admin] PATH_INFO: `/v3/services` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:56.261632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53603421-f894-40a4-94d1-f128d4404f9d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:13:56.261938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53603421-f894-40a4-94d1-f128d4404f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:56.263329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53603421-f894-40a4-94d1-f128d4404f9d None admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:56.271340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 654/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 2 08:13:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:13:56.277936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6a1f5-b261-450e-8c25-4105a793717b None admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:13:56.383300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6a1f5-b261-450e-8c25-4105a793717b None admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:13:56.417553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1245bd5-3d16-4f93-847d-56ea841b4e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:13:56.418191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1245bd5-3d16-4f93-847d-56ea841b4e3e None admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:13:56.418470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1245bd5-3d16-4f93-847d-56ea841b4e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:13:56.418739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1245bd5-3d16-4f93-847d-56ea841b4e3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:13:56.419453 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1245bd5-3d16-4f93-847d-56ea841b4e3e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:13:56.420822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1245bd5-3d16-4f93-847d-56ea841b4e3e None admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:13:56.442602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 652/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:13:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:14:06.268287 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=30 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:14:06.437865 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:01.312350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c7561-0247-43f6-9378-8cb62db74274 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:01.313189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c7561-0247-43f6-9378-8cb62db74274 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:01.313612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c7561-0247-43f6-9378-8cb62db74274 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:01.320798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd395b-c8f3-43be-9981-66dcc5296c84 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:01.321652 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd395b-c8f3-43be-9981-66dcc5296c84 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:01.322108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd395b-c8f3-43be-9981-66dcc5296c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:01.327001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 655/1307] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:01.399289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-8ecd395b-c8f3-43be-9981-66dcc5296c84 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:01.400758 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-8ecd395b-c8f3-43be-9981-66dcc5296c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:01.526758 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 653/1308] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:01.573935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ebfb9-d6f3-46ab-9b68-a32a6348136c None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:01.574754 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ebfb9-d6f3-46ab-9b68-a32a6348136c None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:01.575185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ebfb9-d6f3-46ab-9b68-a32a6348136c None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:01.576988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 656/1309] 10.222.0.57 () {54 vars in 965 bytes} [Tue Aug 2 08:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:01.583629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034962-0487-4172-9e85-7655cbb811f2 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:01.583918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034962-0487-4172-9e85-7655cbb811f2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:01.584198 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6034962-0487-4172-9e85-7655cbb811f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:01.775683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-c6034962-0487-4172-9e85-7655cbb811f2 None None] MFA Rules not processed for user `e68c134016414ea5b851bde233ed9951`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:01.777058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c6034962-0487-4172-9e85-7655cbb811f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:01.831808 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:01.961349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 654/1310] 10.222.0.57 () {58 vars in 1062 bytes} [Tue Aug 2 08:15:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:01.970786 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ebfb9-d6f3-46ab-9b68-a32a6348136c None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:01.972795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3f0ebfb9-d6f3-46ab-9b68-a32a6348136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:02.161185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ebfb9-d6f3-46ab-9b68-a32a6348136c None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:02.249157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f8e21-3d58-40f2-8384-2000be4c1c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:02.250199 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8e21-3d58-40f2-8384-2000be4c1c82 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:02.250784 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8e21-3d58-40f2-8384-2000be4c1c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:02.251418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8e21-3d58-40f2-8384-2000be4c1c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:02.254522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ce8f8e21-3d58-40f2-8384-2000be4c1c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:02.328982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:02.404984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f8e21-3d58-40f2-8384-2000be4c1c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:02.407367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f8e21-3d58-40f2-8384-2000be4c1c82 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:02.438058 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 657/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:15:05.041505 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32232477-64e5-47b3-ad40-51bd4ea3b311 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:05.042139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32232477-64e5-47b3-ad40-51bd4ea3b311 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:05.042375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32232477-64e5-47b3-ad40-51bd4ea3b311 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:05.044437 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 655/1312] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:05.050024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9b9d-c865-4421-8217-9d0b259ce444 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:05.050584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9b9d-c865-4421-8217-9d0b259ce444 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:05.050584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df9b9d-c865-4421-8217-9d0b259ce444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:05.147254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-21df9b9d-c865-4421-8217-9d0b259ce444 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:05.148597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-21df9b9d-c865-4421-8217-9d0b259ce444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:05.285036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 658/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:05.338627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739395a-af8b-41a7-9f4a-7f8dd5c0acc2 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:05.338995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739395a-af8b-41a7-9f4a-7f8dd5c0acc2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:05.339334 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739395a-af8b-41a7-9f4a-7f8dd5c0acc2 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:05.340845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 656/1314] 10.222.0.57 () {54 vars in 965 bytes} [Tue Aug 2 08:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:05.348332 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096a2a6-89ea-4483-a501-d3057a57b0c5 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:05.348712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096a2a6-89ea-4483-a501-d3057a57b0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:05.349157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096a2a6-89ea-4483-a501-d3057a57b0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:05.364987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:05.440679 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-2096a2a6-89ea-4483-a501-d3057a57b0c5 None None] MFA Rules not processed for user `e68c134016414ea5b851bde233ed9951`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:05.441922 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2096a2a6-89ea-4483-a501-d3057a57b0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:05.537364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 659/1315] 10.222.0.57 () {58 vars in 1062 bytes} [Tue Aug 2 08:15:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:05.547485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739395a-af8b-41a7-9f4a-7f8dd5c0acc2 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:05.550602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c739395a-af8b-41a7-9f4a-7f8dd5c0acc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:05.669824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739395a-af8b-41a7-9f4a-7f8dd5c0acc2 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:05.756255 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:05.758989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f68aed-7059-4231-ac61-520a78d0af8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:05.759690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f68aed-7059-4231-ac61-520a78d0af8f service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:05.760232 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f68aed-7059-4231-ac61-520a78d0af8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:05.760763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f68aed-7059-4231-ac61-520a78d0af8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:05.762702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e9f68aed-7059-4231-ac61-520a78d0af8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:05.873795 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f68aed-7059-4231-ac61-520a78d0af8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:05.875263 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f68aed-7059-4231-ac61-520a78d0af8f service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:05.894211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 657/1316] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:08.485391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4577b-ff30-4850-94fe-f46775f2e0ab None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:08.485978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4577b-ff30-4850-94fe-f46775f2e0ab None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:08.486133 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4577b-ff30-4850-94fe-f46775f2e0ab None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:08.488032 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 660/1317] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:08.493871 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c9ea8-a56d-490d-86b9-bbf612c6c3ca None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:08.494405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c9ea8-a56d-490d-86b9-bbf612c6c3ca None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:08.494585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c9ea8-a56d-490d-86b9-bbf612c6c3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:08.573945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-e08c9ea8-a56d-490d-86b9-bbf612c6c3ca None None] MFA Rules not processed for user `5b24fddf649e4ed58d13e5de21990398`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:08.575216 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e08c9ea8-a56d-490d-86b9-bbf612c6c3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:08.627457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:08.671079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 658/1318] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:15:08.712356 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4577b-ff30-4850-94fe-f46775f2e0ab None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:08.713941 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-fde4577b-ff30-4850-94fe-f46775f2e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:08.827205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4577b-ff30-4850-94fe-f46775f2e0ab None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:08.829431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:08.911762 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b71a35-3911-4fe9-9582-e7763806e5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:08.912298 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71a35-3911-4fe9-9582-e7763806e5ec service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:08.912576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71a35-3911-4fe9-9582-e7763806e5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:08.912845 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b71a35-3911-4fe9-9582-e7763806e5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:08.914562 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-06b71a35-3911-4fe9-9582-e7763806e5ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:09.027998 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b71a35-3911-4fe9-9582-e7763806e5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:09.029427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b71a35-3911-4fe9-9582-e7763806e5ec service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:09.047915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 661/1319] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:11.847797 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2769da-e7da-43ff-8a70-ecf0b61651a9 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:11.848338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2769da-e7da-43ff-8a70-ecf0b61651a9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:11.848338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2769da-e7da-43ff-8a70-ecf0b61651a9 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:11.850260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 659/1320] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:11.855545 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432993-6d90-47c5-8892-4d28aee36e85 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:11.856019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432993-6d90-47c5-8892-4d28aee36e85 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:11.856128 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d432993-6d90-47c5-8892-4d28aee36e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:11.898299 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:11.924428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-4d432993-6d90-47c5-8892-4d28aee36e85 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:11.925661 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4d432993-6d90-47c5-8892-4d28aee36e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:12.029411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 662/1321] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:12.069221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2769da-e7da-43ff-8a70-ecf0b61651a9 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:12.070878 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3b2769da-e7da-43ff-8a70-ecf0b61651a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:12.176193 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2769da-e7da-43ff-8a70-ecf0b61651a9 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:12.251664 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d99e3-cc98-477a-92a2-211833df2040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:12.252280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d99e3-cc98-477a-92a2-211833df2040 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:12.252559 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d99e3-cc98-477a-92a2-211833df2040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:12.252834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d99e3-cc98-477a-92a2-211833df2040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:12.254513 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9c5d99e3-cc98-477a-92a2-211833df2040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:12.263082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:12.372605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d99e3-cc98-477a-92a2-211833df2040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:12.374072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d99e3-cc98-477a-92a2-211833df2040 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:12.392778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 660/1322] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:15.204481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39619b6b-eba8-4748-bfc3-2751ae4a1596 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:15.205026 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39619b6b-eba8-4748-bfc3-2751ae4a1596 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:15.205119 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39619b6b-eba8-4748-bfc3-2751ae4a1596 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:15.206506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 663/1323] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:15.211844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e4942-5615-4772-a39a-b78ac9dc974b None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:15.212290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e4942-5615-4772-a39a-b78ac9dc974b None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:15.212522 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e4942-5615-4772-a39a-b78ac9dc974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:15.282266 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-723e4942-5615-4772-a39a-b78ac9dc974b None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:15.283451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-723e4942-5615-4772-a39a-b78ac9dc974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:15.343580 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:15.390931 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 661/1324] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:15.428377 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39619b6b-eba8-4748-bfc3-2751ae4a1596 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:15.430051 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-39619b6b-eba8-4748-bfc3-2751ae4a1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:15.573106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39619b6b-eba8-4748-bfc3-2751ae4a1596 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:15.585507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:15.648533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5e566-00da-4e95-b5c4-80d344099195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:15.649158 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5e566-00da-4e95-b5c4-80d344099195 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:15.649444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5e566-00da-4e95-b5c4-80d344099195 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:15.649719 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5e566-00da-4e95-b5c4-80d344099195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:15.651707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-93e5e566-00da-4e95-b5c4-80d344099195 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:15.764547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5e566-00da-4e95-b5c4-80d344099195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:15.765877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5e566-00da-4e95-b5c4-80d344099195 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:15.786733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 664/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:17.889737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29cfe8-11fb-41bf-93d0-a972db5b4eac None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:17.890288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29cfe8-11fb-41bf-93d0-a972db5b4eac None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:17.890288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29cfe8-11fb-41bf-93d0-a972db5b4eac None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:17.891652 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 662/1326] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:17.897254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b43ea-05b2-4322-9976-bdcbdcf3ea22 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:17.897864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b43ea-05b2-4322-9976-bdcbdcf3ea22 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:17.897864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b43ea-05b2-4322-9976-bdcbdcf3ea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:17.952282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:17.974720 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-039b43ea-05b2-4322-9976-bdcbdcf3ea22 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:17.975953 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-039b43ea-05b2-4322-9976-bdcbdcf3ea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:18.082738 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 665/1327] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:18.136885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29cfe8-11fb-41bf-93d0-a972db5b4eac None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:18.138482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9a29cfe8-11fb-41bf-93d0-a972db5b4eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:18.266793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29cfe8-11fb-41bf-93d0-a972db5b4eac None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:18.358914 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed4d14-2b0b-4b2d-bd12-cd250027beb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:18.359811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed4d14-2b0b-4b2d-bd12-cd250027beb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:18.360099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed4d14-2b0b-4b2d-bd12-cd250027beb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:18.360480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed4d14-2b0b-4b2d-bd12-cd250027beb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:18.362274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bfed4d14-2b0b-4b2d-bd12-cd250027beb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:18.380783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:18.499925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed4d14-2b0b-4b2d-bd12-cd250027beb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:18.501384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed4d14-2b0b-4b2d-bd12-cd250027beb3 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:18.523702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 663/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:20.650312 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0b26-a745-4fcd-b7dc-e93100011e7d None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:20.650856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0b26-a745-4fcd-b7dc-e93100011e7d None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:20.650856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b0b26-a745-4fcd-b7dc-e93100011e7d None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:20.652609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 666/1329] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:20.658479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672416-014a-418f-bc86-fc3197a46872 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:20.658965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672416-014a-418f-bc86-fc3197a46872 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:20.659072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c672416-014a-418f-bc86-fc3197a46872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:20.750307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-9c672416-014a-418f-bc86-fc3197a46872 None None] MFA Rules not processed for user `5b24fddf649e4ed58d13e5de21990398`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:20.751553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9c672416-014a-418f-bc86-fc3197a46872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:20.822408 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:20.857435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 664/1330] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:20.895794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b0b26-a745-4fcd-b7dc-e93100011e7d None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:20.899188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-db7b0b26-a745-4fcd-b7dc-e93100011e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:21.024348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b0b26-a745-4fcd-b7dc-e93100011e7d None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:21.045190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:21.105828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1fbae-036d-43e1-83d6-f515b230dcff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:21.106493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1fbae-036d-43e1-83d6-f515b230dcff service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:21.106772 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1fbae-036d-43e1-83d6-f515b230dcff service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:21.107045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1fbae-036d-43e1-83d6-f515b230dcff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:21.108701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-a6b1fbae-036d-43e1-83d6-f515b230dcff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:21.252915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1fbae-036d-43e1-83d6-f515b230dcff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:21.254460 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1fbae-036d-43e1-83d6-f515b230dcff service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:21.280879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 667/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:23.721860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074d6e-366c-419b-99bc-289d42e456ad None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:23.722431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074d6e-366c-419b-99bc-289d42e456ad None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:23.722526 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074d6e-366c-419b-99bc-289d42e456ad None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:23.724581 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 665/1332] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:23.730216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12472202-a55d-4fe7-8a82-980ab4f5495b None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:23.730774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12472202-a55d-4fe7-8a82-980ab4f5495b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:23.730774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12472202-a55d-4fe7-8a82-980ab4f5495b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:23.797028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:23.801088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-12472202-a55d-4fe7-8a82-980ab4f5495b None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:23.803132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-12472202-a55d-4fe7-8a82-980ab4f5495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:23.908137 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 668/1333] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:15:23.947282 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074d6e-366c-419b-99bc-289d42e456ad None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:23.949044 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-51074d6e-366c-419b-99bc-289d42e456ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:24.056472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074d6e-366c-419b-99bc-289d42e456ad None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:24.145273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8114f9-af02-41ab-afa3-6ad36da1aeeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:24.146085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8114f9-af02-41ab-afa3-6ad36da1aeeb service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:24.146432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8114f9-af02-41ab-afa3-6ad36da1aeeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:24.146748 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8114f9-af02-41ab-afa3-6ad36da1aeeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:24.149032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3a8114f9-af02-41ab-afa3-6ad36da1aeeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:24.181109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:24.273000 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8114f9-af02-41ab-afa3-6ad36da1aeeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:24.274391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8114f9-af02-41ab-afa3-6ad36da1aeeb service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:24.292879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 666/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:26.352413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418eca2-2672-4c91-917c-6ccc5461db9d None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:26.352987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418eca2-2672-4c91-917c-6ccc5461db9d None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:26.352987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418eca2-2672-4c91-917c-6ccc5461db9d None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:26.354451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 669/1335] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:26.360014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b631a5-ed93-406b-bbe3-95f73d968768 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:26.360413 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b631a5-ed93-406b-bbe3-95f73d968768 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:26.360576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b631a5-ed93-406b-bbe3-95f73d968768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:26.430134 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-01b631a5-ed93-406b-bbe3-95f73d968768 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:26.431388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-01b631a5-ed93-406b-bbe3-95f73d968768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:26.513519 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:26.544922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 667/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:26.586350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418eca2-2672-4c91-917c-6ccc5461db9d None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:26.587901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3418eca2-2672-4c91-917c-6ccc5461db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:26.696979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418eca2-2672-4c91-917c-6ccc5461db9d None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:26.726086 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:26.773183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4640d5-ed97-4991-a64e-d6a9c97c1a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:26.773810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4640d5-ed97-4991-a64e-d6a9c97c1a24 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:26.774126 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4640d5-ed97-4991-a64e-d6a9c97c1a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:26.774403 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4640d5-ed97-4991-a64e-d6a9c97c1a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:26.776065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-1a4640d5-ed97-4991-a64e-d6a9c97c1a24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:26.888771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4640d5-ed97-4991-a64e-d6a9c97c1a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:26.890240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4640d5-ed97-4991-a64e-d6a9c97c1a24 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:26.908605 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 670/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:29.422996 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384fd73-5c8b-409d-a0c6-41bfc74dd4cc None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:29.423535 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384fd73-5c8b-409d-a0c6-41bfc74dd4cc None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:29.423535 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384fd73-5c8b-409d-a0c6-41bfc74dd4cc None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:29.424900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 668/1338] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:29.430861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd85097-3b3e-4d3d-9218-5e1be0429bfb None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:29.431324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd85097-3b3e-4d3d-9218-5e1be0429bfb None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:29.431441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd85097-3b3e-4d3d-9218-5e1be0429bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:29.509896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-fcd85097-3b3e-4d3d-9218-5e1be0429bfb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:29.511166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-fcd85097-3b3e-4d3d-9218-5e1be0429bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:29.519691 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:29.614636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 671/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:29.652002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384fd73-5c8b-409d-a0c6-41bfc74dd4cc None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:29.654772 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9384fd73-5c8b-409d-a0c6-41bfc74dd4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:29.776787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384fd73-5c8b-409d-a0c6-41bfc74dd4cc None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:29.852250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f686f2-4010-4607-97b0-dbcd2d5e72bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:29.852895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f686f2-4010-4607-97b0-dbcd2d5e72bc service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:29.853173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f686f2-4010-4607-97b0-dbcd2d5e72bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:29.853448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f686f2-4010-4607-97b0-dbcd2d5e72bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:29.855156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-29f686f2-4010-4607-97b0-dbcd2d5e72bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:29.891723 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:29.968893 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f686f2-4010-4607-97b0-dbcd2d5e72bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:29.971479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f686f2-4010-4607-97b0-dbcd2d5e72bc service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:29.993962 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 669/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:34.085685 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f5ab2-a31c-4d74-bfbe-5245d2d8e26f None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:34.086321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f5ab2-a31c-4d74-bfbe-5245d2d8e26f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:34.086321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f5ab2-a31c-4d74-bfbe-5245d2d8e26f None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:34.087639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 672/1341] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:34.093083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389aa4-3caa-425f-877d-075a2d37a847 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:34.093605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389aa4-3caa-425f-877d-075a2d37a847 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:34.093712 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389aa4-3caa-425f-877d-075a2d37a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:34.165767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-6e389aa4-3caa-425f-877d-075a2d37a847 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:34.169189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-6e389aa4-3caa-425f-877d-075a2d37a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:34.291806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:34.305052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 670/1342] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:34.346098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f5ab2-a31c-4d74-bfbe-5245d2d8e26f None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:34.348037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-068f5ab2-a31c-4d74-bfbe-5245d2d8e26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:34.462913 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f5ab2-a31c-4d74-bfbe-5245d2d8e26f None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:34.500832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:34.543175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae959a-c5b7-453e-b83e-69904cc359e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:34.543933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae959a-c5b7-453e-b83e-69904cc359e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:34.543933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae959a-c5b7-453e-b83e-69904cc359e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:34.544173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae959a-c5b7-453e-b83e-69904cc359e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:34.545814 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-34ae959a-c5b7-453e-b83e-69904cc359e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:34.665393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae959a-c5b7-453e-b83e-69904cc359e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:34.666867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae959a-c5b7-453e-b83e-69904cc359e5 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:34.686998 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 673/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:37.373883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cf454-b3fd-44fc-b08c-ecd968242db0 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:37.374444 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cf454-b3fd-44fc-b08c-ecd968242db0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:37.374559 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cf454-b3fd-44fc-b08c-ecd968242db0 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:37.378153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 671/1344] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:37.382108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3df12-160e-4cf3-bf11-1ba1a0e41467 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:37.382616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3df12-160e-4cf3-bf11-1ba1a0e41467 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:37.382712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3df12-160e-4cf3-bf11-1ba1a0e41467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:37.459471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-31a3df12-160e-4cf3-bf11-1ba1a0e41467 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:37.460727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-31a3df12-160e-4cf3-bf11-1ba1a0e41467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:37.480572 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:37.564819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 674/1345] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:37.603658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cf454-b3fd-44fc-b08c-ecd968242db0 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:37.605297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-be0cf454-b3fd-44fc-b08c-ecd968242db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:37.722141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cf454-b3fd-44fc-b08c-ecd968242db0 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:37.802978 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322f310-276a-45c1-abe2-06d3f55df18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:37.803506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322f310-276a-45c1-abe2-06d3f55df18d service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:37.803870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322f310-276a-45c1-abe2-06d3f55df18d service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:37.809824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322f310-276a-45c1-abe2-06d3f55df18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:37.809824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b322f310-276a-45c1-abe2-06d3f55df18d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:37.873670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:37.954561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322f310-276a-45c1-abe2-06d3f55df18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:37.956034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322f310-276a-45c1-abe2-06d3f55df18d service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:37.976377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 672/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:42.450899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b2a97-2619-45c1-b7d1-c5237e34d8d3 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:42.451378 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b2a97-2619-45c1-b7d1-c5237e34d8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:42.451500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b2a97-2619-45c1-b7d1-c5237e34d8d3 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:42.452812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 675/1347] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:42.458637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8efd57-b4f8-4792-a6e2-b9dd192c5639 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:42.459063 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8efd57-b4f8-4792-a6e2-b9dd192c5639 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:42.459191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8efd57-b4f8-4792-a6e2-b9dd192c5639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:42.541257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-4e8efd57-b4f8-4792-a6e2-b9dd192c5639 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:42.542315 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4e8efd57-b4f8-4792-a6e2-b9dd192c5639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:42.646820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:42.650097 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 673/1348] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:42.689890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b2a97-2619-45c1-b7d1-c5237e34d8d3 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:42.691625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-bb6b2a97-2619-45c1-b7d1-c5237e34d8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:42.817929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b2a97-2619-45c1-b7d1-c5237e34d8d3 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:42.867802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:42.895911 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb1a5a-9b48-4040-a644-56e5a2c70280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:42.896538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb1a5a-9b48-4040-a644-56e5a2c70280 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:42.896817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb1a5a-9b48-4040-a644-56e5a2c70280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:42.897090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb1a5a-9b48-4040-a644-56e5a2c70280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:42.898833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-03cb1a5a-9b48-4040-a644-56e5a2c70280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:43.011508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb1a5a-9b48-4040-a644-56e5a2c70280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:43.013037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb1a5a-9b48-4040-a644-56e5a2c70280 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:43.031486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 676/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:15:48.035176 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e944a-6171-4f12-b5c6-06b6f92cbeb0 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:48.036864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e944a-6171-4f12-b5c6-06b6f92cbeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:48.036954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e944a-6171-4f12-b5c6-06b6f92cbeb0 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:48.043352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 674/1350] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 08:15:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:48.051401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600021b3-1ac4-47ad-8ec5-3f119f1aab4e None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:48.053148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600021b3-1ac4-47ad-8ec5-3f119f1aab4e None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:48.053651 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600021b3-1ac4-47ad-8ec5-3f119f1aab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:48.149841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-600021b3-1ac4-47ad-8ec5-3f119f1aab4e None None] MFA Rules not processed for user `3318842c46ec4c6d9b7b1f55c9fab62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:48.151093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-600021b3-1ac4-47ad-8ec5-3f119f1aab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:48.171499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:48.333682 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 677/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 08:15:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:52.728963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a169a-d624-4e60-a0f4-a4efa4178e68 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:52.729536 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a169a-d624-4e60-a0f4-a4efa4178e68 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:52.729968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a169a-d624-4e60-a0f4-a4efa4178e68 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:52.731492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 675/1352] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 08:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:52.737200 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31c8ae-83a6-4dff-833d-407c4c51e3df None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:52.738242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31c8ae-83a6-4dff-833d-407c4c51e3df None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:52.738342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31c8ae-83a6-4dff-833d-407c4c51e3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:52.826652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-ee31c8ae-83a6-4dff-833d-407c4c51e3df None None] MFA Rules not processed for user `3318842c46ec4c6d9b7b1f55c9fab62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:52.828243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ee31c8ae-83a6-4dff-833d-407c4c51e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:52.905365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:52.950952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 678/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 08:15:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:54.314205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093f81e-81d0-4a6f-9cf3-93bd1f121391 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:54.314766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093f81e-81d0-4a6f-9cf3-93bd1f121391 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:54.314766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093f81e-81d0-4a6f-9cf3-93bd1f121391 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:54.316668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 676/1354] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 08:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:54.321765 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66626eb2-4ab8-46c8-8867-bbf0d58e8530 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:54.322247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66626eb2-4ab8-46c8-8867-bbf0d58e8530 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:54.322559 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66626eb2-4ab8-46c8-8867-bbf0d58e8530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:54.406490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-66626eb2-4ab8-46c8-8867-bbf0d58e8530 None None] MFA Rules not processed for user `3318842c46ec4c6d9b7b1f55c9fab62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:54.407700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-66626eb2-4ab8-46c8-8867-bbf0d58e8530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:54.522472 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 679/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 08:15:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:57.948442 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb1a78-ef5a-4d10-8370-d05794e77787 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:57.949050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb1a78-ef5a-4d10-8370-d05794e77787 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:57.949050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb1a78-ef5a-4d10-8370-d05794e77787 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:57.950642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 677/1356] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:57.956597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf7d2c-72de-4c8d-a12b-5eb43454c995 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:57.957062 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf7d2c-72de-4c8d-a12b-5eb43454c995 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:57.957235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf7d2c-72de-4c8d-a12b-5eb43454c995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:58.018184 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:58.054344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-96bf7d2c-72de-4c8d-a12b-5eb43454c995 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:58.056021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-96bf7d2c-72de-4c8d-a12b-5eb43454c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:58.181223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 680/1357] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:58.235829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e72ec3-96b1-49f3-8fc4-820d9e30af6f None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:58.236112 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e72ec3-96b1-49f3-8fc4-820d9e30af6f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:58.236458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e72ec3-96b1-49f3-8fc4-820d9e30af6f None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:58.237770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 678/1358] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 2 08:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:15:58.247991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c498bd1-1230-45f8-8e4d-f0ef2a60a846 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:58.249016 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c498bd1-1230-45f8-8e4d-f0ef2a60a846 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:58.252644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c498bd1-1230-45f8-8e4d-f0ef2a60a846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:58.344698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-2c498bd1-1230-45f8-8e4d-f0ef2a60a846 None None] MFA Rules not processed for user `93143507a8784a30bc6b4a5e1f24f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:15:58.346095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2c498bd1-1230-45f8-8e4d-f0ef2a60a846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:58.403118 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:58.476546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 681/1359] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 2 08:15:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:15:58.485239 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e72ec3-96b1-49f3-8fc4-820d9e30af6f None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:15:58.486883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c3e72ec3-96b1-49f3-8fc4-820d9e30af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:58.657656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e72ec3-96b1-49f3-8fc4-820d9e30af6f None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:15:58.739264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:15:58.787980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72936b-dbfc-46ca-9b42-1b59a35ea707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:15:58.788724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72936b-dbfc-46ca-9b42-1b59a35ea707 service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:15:58.789062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72936b-dbfc-46ca-9b42-1b59a35ea707 service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:15:58.789407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72936b-dbfc-46ca-9b42-1b59a35ea707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:15:58.791039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-cb72936b-dbfc-46ca-9b42-1b59a35ea707 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:15:58.911026 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72936b-dbfc-46ca-9b42-1b59a35ea707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:15:58.912791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72936b-dbfc-46ca-9b42-1b59a35ea707 service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:15:58.936803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 679/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:01.204926 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec97512-8243-4259-8420-2b0a8b3f0640 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:01.205479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec97512-8243-4259-8420-2b0a8b3f0640 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:01.205479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec97512-8243-4259-8420-2b0a8b3f0640 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:01.207584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 682/1361] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:01.213715 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135478-4299-48b5-83b5-61bae05d7ad0 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:01.215941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135478-4299-48b5-83b5-61bae05d7ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:01.216235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa135478-4299-48b5-83b5-61bae05d7ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:01.309384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-aa135478-4299-48b5-83b5-61bae05d7ad0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:01.310598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-aa135478-4299-48b5-83b5-61bae05d7ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:01.357966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:01.453890 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 680/1362] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:01.503383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec97512-8243-4259-8420-2b0a8b3f0640 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:01.504865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-cec97512-8243-4259-8420-2b0a8b3f0640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:01.686529 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec97512-8243-4259-8420-2b0a8b3f0640 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:01.698126 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:01.875183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e7560-0e33-43c3-ace5-12610dfa3998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:01.875810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7560-0e33-43c3-ace5-12610dfa3998 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:01.876091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7560-0e33-43c3-ace5-12610dfa3998 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:01.876366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7560-0e33-43c3-ace5-12610dfa3998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:01.878625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-845e7560-0e33-43c3-ace5-12610dfa3998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:01.980324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e7560-0e33-43c3-ace5-12610dfa3998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:01.981938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e7560-0e33-43c3-ace5-12610dfa3998 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:02.003600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 683/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:04.475066 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1934c-553d-4e9e-805f-521e58fec052 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:04.475689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1934c-553d-4e9e-805f-521e58fec052 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:04.475689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1934c-553d-4e9e-805f-521e58fec052 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:04.478679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 681/1364] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:04.483553 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e76bb-359d-43e7-9bcf-d646c7bae99f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:04.483553 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e76bb-359d-43e7-9bcf-d646c7bae99f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:04.483553 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e76bb-359d-43e7-9bcf-d646c7bae99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:04.501173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:04.566251 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-0d5e76bb-359d-43e7-9bcf-d646c7bae99f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:04.567662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0d5e76bb-359d-43e7-9bcf-d646c7bae99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:04.690618 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 684/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:04.734304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4733da9-9541-4500-9e9f-def3e7c41a4e None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:04.734603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4733da9-9541-4500-9e9f-def3e7c41a4e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:04.734996 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4733da9-9541-4500-9e9f-def3e7c41a4e None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:04.736503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 682/1366] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 2 08:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:04.744115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfdb8a-7f85-4232-af2e-0a9ce3825008 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:04.744692 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfdb8a-7f85-4232-af2e-0a9ce3825008 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:04.745199 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfdb8a-7f85-4232-af2e-0a9ce3825008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:04.836918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-43dfdb8a-7f85-4232-af2e-0a9ce3825008 None None] MFA Rules not processed for user `93143507a8784a30bc6b4a5e1f24f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:04.838228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-43dfdb8a-7f85-4232-af2e-0a9ce3825008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:04.879651 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:04.979849 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 685/1367] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 2 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:16:04.987872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4733da9-9541-4500-9e9f-def3e7c41a4e None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:04.989405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b4733da9-9541-4500-9e9f-def3e7c41a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:05.157528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4733da9-9541-4500-9e9f-def3e7c41a4e None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:05.181730 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:05.284916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8bfc0-0e43-4c53-b700-03365e51be08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:05.285454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8bfc0-0e43-4c53-b700-03365e51be08 service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:05.285735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8bfc0-0e43-4c53-b700-03365e51be08 service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:05.286036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8bfc0-0e43-4c53-b700-03365e51be08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:05.287677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9cc8bfc0-0e43-4c53-b700-03365e51be08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:05.407364 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8bfc0-0e43-4c53-b700-03365e51be08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:05.409921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8bfc0-0e43-4c53-b700-03365e51be08 service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:05.430114 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 683/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:06.374355 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248183-1602-4085-a18b-8fd8303f010a None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:06.374903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248183-1602-4085-a18b-8fd8303f010a None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:06.374903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248183-1602-4085-a18b-8fd8303f010a None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:06.376452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 686/1369] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:06.382316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeba99-c766-444b-9033-099b333fbc6d None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:06.382789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeba99-c766-444b-9033-099b333fbc6d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:06.382879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaeba99-c766-444b-9033-099b333fbc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:06.416344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:06.455874 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-aeaeba99-c766-444b-9033-099b333fbc6d None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:06.457097 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-aeaeba99-c766-444b-9033-099b333fbc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:06.568877 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 684/1370] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:06.883576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e3075-bd8c-40ad-a100-266f8638d31d None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:06.883936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e3075-bd8c-40ad-a100-266f8638d31d None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:06.884357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e3075-bd8c-40ad-a100-266f8638d31d None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:06.885895 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 687/1371] 10.222.0.57 () {54 vars in 964 bytes} [Tue Aug 2 08:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:06.891013 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e1e42-90a9-42fd-af0d-a00b87baddd4 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:06.891378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e1e42-90a9-42fd-af0d-a00b87baddd4 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:06.891665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e1e42-90a9-42fd-af0d-a00b87baddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:06.979951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-576e1e42-90a9-42fd-af0d-a00b87baddd4 None None] MFA Rules not processed for user `6557be84abb6469d95157570517512fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:06.981170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-576e1e42-90a9-42fd-af0d-a00b87baddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:07.042274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:07.079364 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 685/1372] 10.222.0.57 () {58 vars in 1061 bytes} [Tue Aug 2 08:16:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:07.088420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e3075-bd8c-40ad-a100-266f8638d31d None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:07.089295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4d1e3075-bd8c-40ad-a100-266f8638d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:07.209043 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e3075-bd8c-40ad-a100-266f8638d31d None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:07.255550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:07.294534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc98c30-a913-48f4-8715-b42a5eecc2f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:07.295161 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98c30-a913-48f4-8715-b42a5eecc2f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:07.295435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98c30-a913-48f4-8715-b42a5eecc2f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:07.295701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98c30-a913-48f4-8715-b42a5eecc2f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:07.297441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2fc98c30-a913-48f4-8715-b42a5eecc2f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:07.425222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc98c30-a913-48f4-8715-b42a5eecc2f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:07.426709 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc98c30-a913-48f4-8715-b42a5eecc2f4 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:07.448674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 688/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:07.552412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92fb2d-e340-4764-91ef-019fcf597b64 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:07.552833 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92fb2d-e340-4764-91ef-019fcf597b64 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:07.553042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92fb2d-e340-4764-91ef-019fcf597b64 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:07.555357 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 686/1374] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:07.560865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789c1d-afe8-48d6-b546-fc1edb1834df None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:07.561276 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789c1d-afe8-48d6-b546-fc1edb1834df None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:07.561796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789c1d-afe8-48d6-b546-fc1edb1834df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:07.637955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-49789c1d-afe8-48d6-b546-fc1edb1834df None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:07.639171 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-49789c1d-afe8-48d6-b546-fc1edb1834df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:07.664892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:07.770583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 689/1375] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:07.811122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92fb2d-e340-4764-91ef-019fcf597b64 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:07.812856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-2b92fb2d-e340-4764-91ef-019fcf597b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:07.964955 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92fb2d-e340-4764-91ef-019fcf597b64 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:08.019181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:08.085655 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e483e-665d-40fe-bfa9-95778665034a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:08.086737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e483e-665d-40fe-bfa9-95778665034a service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:08.087123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e483e-665d-40fe-bfa9-95778665034a service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:08.087536 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e483e-665d-40fe-bfa9-95778665034a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:08.089995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f13e483e-665d-40fe-bfa9-95778665034a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:08.195239 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e483e-665d-40fe-bfa9-95778665034a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:08.196989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e483e-665d-40fe-bfa9-95778665034a service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:08.234787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 687/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:10.319450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54d70-5c58-4bc0-ad55-4eb167ff3191 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:10.319977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54d70-5c58-4bc0-ad55-4eb167ff3191 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:10.319977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b54d70-5c58-4bc0-ad55-4eb167ff3191 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:10.321667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 690/1377] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:10.327288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362731-5866-4d35-b4c7-3847d185ade9 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:10.327845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362731-5866-4d35-b4c7-3847d185ade9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:10.327997 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66362731-5866-4d35-b4c7-3847d185ade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:10.400191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-66362731-5866-4d35-b4c7-3847d185ade9 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:10.401414 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-66362731-5866-4d35-b4c7-3847d185ade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:10.408680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:10.504669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 688/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:10.549719 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b54d70-5c58-4bc0-ad55-4eb167ff3191 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:10.551284 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d0b54d70-5c58-4bc0-ad55-4eb167ff3191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:10.773650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b54d70-5c58-4bc0-ad55-4eb167ff3191 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:10.778205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:10.898193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06133421-11fe-4a8e-974c-71c86f9168fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:10.898839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06133421-11fe-4a8e-974c-71c86f9168fa service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:10.899145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06133421-11fe-4a8e-974c-71c86f9168fa service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:10.899488 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06133421-11fe-4a8e-974c-71c86f9168fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:10.901173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-06133421-11fe-4a8e-974c-71c86f9168fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:10.998672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06133421-11fe-4a8e-974c-71c86f9168fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:11.000298 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06133421-11fe-4a8e-974c-71c86f9168fa service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:11.020394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 691/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:13.135821 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26381c6-f3f8-4e09-921b-58628d2ce67f None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:13.136384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26381c6-f3f8-4e09-921b-58628d2ce67f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:13.136384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26381c6-f3f8-4e09-921b-58628d2ce67f None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:13.137927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 689/1380] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:13.143363 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efaaa4-1a25-4fed-a832-fb3dff97760c None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:13.143878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efaaa4-1a25-4fed-a832-fb3dff97760c None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:13.143878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efaaa4-1a25-4fed-a832-fb3dff97760c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:13.156571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:13.221153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-09efaaa4-1a25-4fed-a832-fb3dff97760c None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:13.222410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-09efaaa4-1a25-4fed-a832-fb3dff97760c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:13.347003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 692/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:13.393222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26381c6-f3f8-4e09-921b-58628d2ce67f None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:13.395120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d26381c6-f3f8-4e09-921b-58628d2ce67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:13.563653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:13.579464 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26381c6-f3f8-4e09-921b-58628d2ce67f None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:13.717120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c26e9-1e9f-4364-bca1-dc7c8d8fe12f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:13.717869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c26e9-1e9f-4364-bca1-dc7c8d8fe12f service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:13.718271 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c26e9-1e9f-4364-bca1-dc7c8d8fe12f service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:13.718611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c26e9-1e9f-4364-bca1-dc7c8d8fe12f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:13.720356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bf1c26e9-1e9f-4364-bca1-dc7c8d8fe12f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:13.833080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c26e9-1e9f-4364-bca1-dc7c8d8fe12f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:13.834905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c26e9-1e9f-4364-bca1-dc7c8d8fe12f service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:13.852683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:13.870204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 690/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:15.993976 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c251-bbfd-4784-8713-f7b2716b9ccb None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:15.994687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c251-bbfd-4784-8713-f7b2716b9ccb None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:15.994687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496c251-bbfd-4784-8713-f7b2716b9ccb None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:15.995897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 693/1383] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:16.001208 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba64bb-3a7e-4032-be8e-4b6305d4b0bd None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:16.001655 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba64bb-3a7e-4032-be8e-4b6305d4b0bd None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:16.001762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba64bb-3a7e-4032-be8e-4b6305d4b0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:16.082263 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-bbba64bb-3a7e-4032-be8e-4b6305d4b0bd None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:16.083696 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bbba64bb-3a7e-4032-be8e-4b6305d4b0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:16.199213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 691/1384] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:16.245347 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496c251-bbfd-4784-8713-f7b2716b9ccb None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:16.247041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e496c251-bbfd-4784-8713-f7b2716b9ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:16.360104 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:16.434645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496c251-bbfd-4784-8713-f7b2716b9ccb None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:16.578870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf3b3c-1668-414a-8c05-4b4fca0eed70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:16.579540 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3b3c-1668-414a-8c05-4b4fca0eed70 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:16.579905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3b3c-1668-414a-8c05-4b4fca0eed70 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:16.580291 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf3b3c-1668-414a-8c05-4b4fca0eed70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:16.582830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-fadf3b3c-1668-414a-8c05-4b4fca0eed70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:16.643852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:16.686518 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf3b3c-1668-414a-8c05-4b4fca0eed70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:16.688138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf3b3c-1668-414a-8c05-4b4fca0eed70 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:16.707470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 694/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:18.855148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0353-3fe9-411c-857a-c609c07f5ac9 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:18.855921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0353-3fe9-411c-857a-c609c07f5ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:18.855921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea0353-3fe9-411c-857a-c609c07f5ac9 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:18.857547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 692/1386] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:18.863662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1294d-7003-460f-aca4-cc6602b7f1c7 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:18.864187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1294d-7003-460f-aca4-cc6602b7f1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:18.864187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1294d-7003-460f-aca4-cc6602b7f1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:18.940992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-95a1294d-7003-460f-aca4-cc6602b7f1c7 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:18.942253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-95a1294d-7003-460f-aca4-cc6602b7f1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:19.051247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 695/1387] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:19.103801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea0353-3fe9-411c-857a-c609c07f5ac9 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:19.105466 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7cea0353-3fe9-411c-857a-c609c07f5ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:19.187617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:19.267945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea0353-3fe9-411c-857a-c609c07f5ac9 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:19.408874 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbba58-6209-4a94-ad57-da285ea98f4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:19.409505 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbba58-6209-4a94-ad57-da285ea98f4f service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:19.409804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbba58-6209-4a94-ad57-da285ea98f4f service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:19.410251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbba58-6209-4a94-ad57-da285ea98f4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:19.411821 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-dbcbba58-6209-4a94-ad57-da285ea98f4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:19.456370 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:19.533697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbba58-6209-4a94-ad57-da285ea98f4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:19.535372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbba58-6209-4a94-ad57-da285ea98f4f service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:19.562893 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 693/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:22.062095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901180de-ccc5-4e38-92bd-0525e321afcf None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:22.062646 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901180de-ccc5-4e38-92bd-0525e321afcf None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:22.062646 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901180de-ccc5-4e38-92bd-0525e321afcf None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:22.064055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 696/1389] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:22.069565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d3ee4-eb79-4a04-bc3f-3312608f495e None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:22.070149 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d3ee4-eb79-4a04-bc3f-3312608f495e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:22.070272 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d3ee4-eb79-4a04-bc3f-3312608f495e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:22.139239 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-de6d3ee4-eb79-4a04-bc3f-3312608f495e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:22.140452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-de6d3ee4-eb79-4a04-bc3f-3312608f495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:22.243888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 694/1390] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:22.289998 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901180de-ccc5-4e38-92bd-0525e321afcf None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:22.291591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-901180de-ccc5-4e38-92bd-0525e321afcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:22.326232 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:22.450731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901180de-ccc5-4e38-92bd-0525e321afcf None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:22.564708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:22.585869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf48b27-7973-444c-9acc-6eacada5ac21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:22.586877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf48b27-7973-444c-9acc-6eacada5ac21 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:22.586877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf48b27-7973-444c-9acc-6eacada5ac21 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:22.586877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf48b27-7973-444c-9acc-6eacada5ac21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:22.588575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-dcf48b27-7973-444c-9acc-6eacada5ac21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:22.687156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf48b27-7973-444c-9acc-6eacada5ac21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:22.688760 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf48b27-7973-444c-9acc-6eacada5ac21 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:22.708985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 697/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:23.192109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b630-4436-459f-8ab1-a7a5b9c66605 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:23.192668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b630-4436-459f-8ab1-a7a5b9c66605 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:23.192668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b630-4436-459f-8ab1-a7a5b9c66605 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:23.194119 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 695/1392] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:23.199645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419fb7-fbf4-4b65-9b61-a1f1a81c47f1 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:23.200095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419fb7-fbf4-4b65-9b61-a1f1a81c47f1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:23.200313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419fb7-fbf4-4b65-9b61-a1f1a81c47f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:23.290558 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-f9419fb7-fbf4-4b65-9b61-a1f1a81c47f1 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:23.291811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-f9419fb7-fbf4-4b65-9b61-a1f1a81c47f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:23.357079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:23.406551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 698/1393] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:23.464199 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7a7b5-479a-4de6-ab76-45f2113e3e4c None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:23.464483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7a7b5-479a-4de6-ab76-45f2113e3e4c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:23.464755 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7a7b5-479a-4de6-ab76-45f2113e3e4c None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:23.466137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 696/1394] 10.222.0.57 () {54 vars in 966 bytes} [Tue Aug 2 08:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:23.471513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d723-9832-46ec-8aae-eb4775747397 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:23.471779 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d723-9832-46ec-8aae-eb4775747397 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:23.472573 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d723-9832-46ec-8aae-eb4775747397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:23.561357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-9d26d723-9832-46ec-8aae-eb4775747397 None None] MFA Rules not processed for user `739b8f31f1d74459a7348c3ed699812c`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:23.562783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9d26d723-9832-46ec-8aae-eb4775747397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:23.651994 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 699/1395] 10.222.0.57 () {58 vars in 1063 bytes} [Tue Aug 2 08:16:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:16:23.660986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7a7b5-479a-4de6-ab76-45f2113e3e4c None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:23.662576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-31f7a7b5-479a-4de6-ab76-45f2113e3e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:23.678377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:23.792665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7a7b5-479a-4de6-ab76-45f2113e3e4c None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:23.897582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0de118-8d91-4d32-9d54-acf1cc1d527f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '739b8f31f1d74459a7348c3ed699812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:23.898474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de118-8d91-4d32-9d54-acf1cc1d527f service glance] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:23.898803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de118-8d91-4d32-9d54-acf1cc1d527f service glance] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:23.899244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de118-8d91-4d32-9d54-acf1cc1d527f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:23.907758 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bf0de118-8d91-4d32-9d54-acf1cc1d527f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:23.985452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:24.031763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0de118-8d91-4d32-9d54-acf1cc1d527f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:24.033497 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0de118-8d91-4d32-9d54-acf1cc1d527f service glance] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:24.053157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 697/1396] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:24.832155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fd247-4983-4485-a01a-8b7dbfd4719a None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:24.832880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fd247-4983-4485-a01a-8b7dbfd4719a None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:24.833330 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fd247-4983-4485-a01a-8b7dbfd4719a None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:24.838058 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 700/1397] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:24.844667 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82369df-73c2-40ac-b05c-822d264bf69e None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:24.845244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82369df-73c2-40ac-b05c-822d264bf69e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:24.845244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82369df-73c2-40ac-b05c-822d264bf69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:24.846615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1f4ea-8885-4ce9-9f7d-4934833a29ea None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:24.847056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1f4ea-8885-4ce9-9f7d-4934833a29ea None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:24.848244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1f4ea-8885-4ce9-9f7d-4934833a29ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:24.928086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-c82369df-73c2-40ac-b05c-822d264bf69e None None] MFA Rules not processed for user `ad48c627d5d142489f40584eea36a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:24.929316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c82369df-73c2-40ac-b05c-822d264bf69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:25.040241 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 698/1398] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:16:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:25.059290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-69c1f4ea-8885-4ce9-9f7d-4934833a29ea None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:25.060539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-69c1f4ea-8885-4ce9-9f7d-4934833a29ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:25.075015 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:25.089917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391201-c024-40a4-b3f3-2349c73cb930 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:25.090274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391201-c024-40a4-b3f3-2349c73cb930 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:25.091044 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c391201-c024-40a4-b3f3-2349c73cb930 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:25.092623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 699/1399] 10.222.0.57 () {54 vars in 943 bytes} [Tue Aug 2 08:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:16:25.100178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a01286-444c-4dd5-b11d-d06f65d29ca0 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:25.100460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a01286-444c-4dd5-b11d-d06f65d29ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:25.100751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a01286-444c-4dd5-b11d-d06f65d29ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:25.146412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:25.188290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 701/1400] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:25.189361 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-08a01286-444c-4dd5-b11d-d06f65d29ca0 None None] MFA Rules not processed for user `e02b653d2f5e4faca2906b2fbd1bfc5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:25.190571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-08a01286-444c-4dd5-b11d-d06f65d29ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:25.234108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1f4ea-8885-4ce9-9f7d-4934833a29ea None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:25.235298 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-69c1f4ea-8885-4ce9-9f7d-4934833a29ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:25.316273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 700/1401] 10.222.0.57 () {58 vars in 1040 bytes} [Tue Aug 2 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:16:25.326272 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a01286-444c-4dd5-b11d-d06f65d29ca0 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:25.338339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a01286-444c-4dd5-b11d-d06f65d29ca0 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:25.379689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1f4ea-8885-4ce9-9f7d-4934833a29ea None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:25.411113 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:25.429668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:25.459786 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f232c3-d98a-42b1-8bf3-4536f5d0ea98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02b653d2f5e4faca2906b2fbd1bfc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:25.460321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f232c3-d98a-42b1-8bf3-4536f5d0ea98 service swift] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:25.460603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f232c3-d98a-42b1-8bf3-4536f5d0ea98 service swift] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:25.460877 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f232c3-d98a-42b1-8bf3-4536f5d0ea98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:25.462688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b6f232c3-d98a-42b1-8bf3-4536f5d0ea98 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:25.512805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78adda2-868c-4e75-b3bb-84c1462a398f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:25.513450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78adda2-868c-4e75-b3bb-84c1462a398f service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:25.513711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78adda2-868c-4e75-b3bb-84c1462a398f service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:25.513979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78adda2-868c-4e75-b3bb-84c1462a398f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:25.515677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c78adda2-868c-4e75-b3bb-84c1462a398f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:25.558042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f232c3-d98a-42b1-8bf3-4536f5d0ea98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:25.559697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f232c3-d98a-42b1-8bf3-4536f5d0ea98 service swift] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:25.569487 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 701/1402] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 08:16:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 08:16:25.615177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78adda2-868c-4e75-b3bb-84c1462a398f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:25.616781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78adda2-868c-4e75-b3bb-84c1462a398f service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:25.637849 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 702/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:27.792228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bdfd-35a5-4047-801d-b65a862fe3ed None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:27.792818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bdfd-35a5-4047-801d-b65a862fe3ed None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:27.792818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482bdfd-35a5-4047-801d-b65a862fe3ed None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:27.794190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 702/1404] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:27.800637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2d740-f0e0-4bc4-865a-280a8a41c2e1 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:27.801150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2d740-f0e0-4bc4-865a-280a8a41c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:27.801150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2d740-f0e0-4bc4-865a-280a8a41c2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:27.862994 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:27.893798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-30a2d740-f0e0-4bc4-865a-280a8a41c2e1 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:27.895260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-30a2d740-f0e0-4bc4-865a-280a8a41c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:28.071887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 703/1405] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:28.124088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482bdfd-35a5-4047-801d-b65a862fe3ed None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:28.126334 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-6482bdfd-35a5-4047-801d-b65a862fe3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:28.275397 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:28.317177 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482bdfd-35a5-4047-801d-b65a862fe3ed None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:28.468389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92572d3a-8e18-48bb-9d80-a3039c1d15b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:28.469017 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92572d3a-8e18-48bb-9d80-a3039c1d15b3 service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:28.469295 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92572d3a-8e18-48bb-9d80-a3039c1d15b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:28.469569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92572d3a-8e18-48bb-9d80-a3039c1d15b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:28.471278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-92572d3a-8e18-48bb-9d80-a3039c1d15b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:28.568094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:28.582113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92572d3a-8e18-48bb-9d80-a3039c1d15b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:28.583784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92572d3a-8e18-48bb-9d80-a3039c1d15b3 service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:28.603988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 703/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:30.721490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0ba8c-b871-49e4-a779-0d0592f68600 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:30.722306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0ba8c-b871-49e4-a779-0d0592f68600 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:30.722306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0ba8c-b871-49e4-a779-0d0592f68600 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:30.723425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 704/1407] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:30.728864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520f935-88b5-46f3-8e06-fefff7c84c85 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:30.729358 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520f935-88b5-46f3-8e06-fefff7c84c85 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:30.729452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520f935-88b5-46f3-8e06-fefff7c84c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:30.811239 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-0520f935-88b5-46f3-8e06-fefff7c84c85 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:30.812550 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-0520f935-88b5-46f3-8e06-fefff7c84c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:30.940403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 704/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:30.984655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0ba8c-b871-49e4-a779-0d0592f68600 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:30.986741 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8de0ba8c-b871-49e4-a779-0d0592f68600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:31.130796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:31.192371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0ba8c-b871-49e4-a779-0d0592f68600 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:31.317394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61262d-4b0f-40af-a57d-833ad62f7f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:31.317959 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61262d-4b0f-40af-a57d-833ad62f7f52 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:31.320170 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61262d-4b0f-40af-a57d-833ad62f7f52 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:31.320170 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61262d-4b0f-40af-a57d-833ad62f7f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:31.320170 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-bf61262d-4b0f-40af-a57d-833ad62f7f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:31.408568 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:31.427877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61262d-4b0f-40af-a57d-833ad62f7f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:31.429601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61262d-4b0f-40af-a57d-833ad62f7f52 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:31.450060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 705/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:40.937888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=74 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:41.447685 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=13 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:48.664809 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98052aa7-33a5-4ac9-8f49-2401bab1515c None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:48.665357 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98052aa7-33a5-4ac9-8f49-2401bab1515c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:48.665357 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98052aa7-33a5-4ac9-8f49-2401bab1515c None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:48.666912 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 705/1410] 10.222.0.57 () {54 vars in 918 bytes} [Tue Aug 2 08:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:48.672901 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59a7c7-cc65-414a-bf7a-eee65bd856e6 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:48.673402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59a7c7-cc65-414a-bf7a-eee65bd856e6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:48.673499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59a7c7-cc65-414a-bf7a-eee65bd856e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:48.754174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-7a59a7c7-cc65-414a-bf7a-eee65bd856e6 None None] MFA Rules not processed for user `3318842c46ec4c6d9b7b1f55c9fab62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:48.755425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7a59a7c7-cc65-414a-bf7a-eee65bd856e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:48.863937 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 706/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Aug 2 08:16:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:16:48.878682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f481670-5ef6-4b4d-b67e-c27cc5eba7c2 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:48.878975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f481670-5ef6-4b4d-b67e-c27cc5eba7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:48.879258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f481670-5ef6-4b4d-b67e-c27cc5eba7c2 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:48.880620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 706/1412] 10.222.0.57 () {54 vars in 918 bytes} [Tue Aug 2 08:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:48.885948 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5e725-d04a-48e6-96af-0b60693727f8 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:48.886278 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5e725-d04a-48e6-96af-0b60693727f8 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:48.886626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5e725-d04a-48e6-96af-0b60693727f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:48.963664 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:48.967033 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-d4c5e725-d04a-48e6-96af-0b60693727f8 None None] MFA Rules not processed for user `93143507a8784a30bc6b4a5e1f24f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:48.969594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d4c5e725-d04a-48e6-96af-0b60693727f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:49.088117 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 707/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Aug 2 08:16:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:51.583628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3cb66-412c-49d5-9767-704582985156 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:51.584203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3cb66-412c-49d5-9767-704582985156 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:51.584203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3cb66-412c-49d5-9767-704582985156 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:51.585555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:51.591305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ca64-4e8a-4abb-b1a3-037fb6d0e688 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:51.591784 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ca64-4e8a-4abb-b1a3-037fb6d0e688 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:51.591896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273ca64-4e8a-4abb-b1a3-037fb6d0e688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:51.661817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-2273ca64-4e8a-4abb-b1a3-037fb6d0e688 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:51.662360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2273ca64-4e8a-4abb-b1a3-037fb6d0e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:51.718669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:51.764150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:51.808928 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3cb66-412c-49d5-9767-704582985156 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:51.810633 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-eca3cb66-412c-49d5-9767-704582985156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:51.964574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3cb66-412c-49d5-9767-704582985156 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:52.042312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:52.083758 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67435595-d665-4f62-a55d-63361da77680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:52.084380 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67435595-d665-4f62-a55d-63361da77680 service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:52.084659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67435595-d665-4f62-a55d-63361da77680 service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:52.084932 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67435595-d665-4f62-a55d-63361da77680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:52.086638 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-67435595-d665-4f62-a55d-63361da77680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:52.188267 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67435595-d665-4f62-a55d-63361da77680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:52.189914 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67435595-d665-4f62-a55d-63361da77680 service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:52.208816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 708/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:53.136043 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf4e62-63f3-442a-8e6d-f145ba67398d None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:53.136641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf4e62-63f3-442a-8e6d-f145ba67398d None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:53.136641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf4e62-63f3-442a-8e6d-f145ba67398d None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:53.137953 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:16:53.143321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f117a0-77bd-4915-8b09-6c608aa36357 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:53.143844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f117a0-77bd-4915-8b09-6c608aa36357 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:53.143943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f117a0-77bd-4915-8b09-6c608aa36357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:53.222338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-93f117a0-77bd-4915-8b09-6c608aa36357 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:53.223576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-93f117a0-77bd-4915-8b09-6c608aa36357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:53.251929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:53.324379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:53.476424 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf4e62-63f3-442a-8e6d-f145ba67398d None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:53.477988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e7bf4e62-63f3-442a-8e6d-f145ba67398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:53.630439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf4e62-63f3-442a-8e6d-f145ba67398d None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:53.673243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:53.752239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b5a00-6ed9-4b89-ae32-4eb1653c8679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:53.752805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5a00-6ed9-4b89-ae32-4eb1653c8679 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:53.753085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5a00-6ed9-4b89-ae32-4eb1653c8679 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:53.753359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5a00-6ed9-4b89-ae32-4eb1653c8679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:53.755091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9b4b5a00-6ed9-4b89-ae32-4eb1653c8679 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:53.853273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b5a00-6ed9-4b89-ae32-4eb1653c8679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:53.854883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b5a00-6ed9-4b89-ae32-4eb1653c8679 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:53.873271 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 710/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:54.761889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d15d-093c-44f0-9bd4-8c751b0fecff None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:54.762563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d15d-093c-44f0-9bd4-8c751b0fecff None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:54.762563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2d15d-093c-44f0-9bd4-8c751b0fecff None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:54.763848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:54.769898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff20d-fd19-41ad-abdf-866397f2358f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:54.770427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff20d-fd19-41ad-abdf-866397f2358f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:54.770546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ff20d-fd19-41ad-abdf-866397f2358f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:54.828063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:54.851678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-cd2ff20d-fd19-41ad-abdf-866397f2358f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:54.852919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-cd2ff20d-fd19-41ad-abdf-866397f2358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:54.955680 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:55.114569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2d15d-093c-44f0-9bd4-8c751b0fecff None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:55.116373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-20d2d15d-093c-44f0-9bd4-8c751b0fecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:55.265253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2d15d-093c-44f0-9bd4-8c751b0fecff None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:55.278312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:55.384157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e3a83-aa98-44c7-8984-2f1bf921c759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:55.384690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3a83-aa98-44c7-8984-2f1bf921c759 service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:55.384964 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3a83-aa98-44c7-8984-2f1bf921c759 service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:55.385233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3a83-aa98-44c7-8984-2f1bf921c759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:55.386917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b18e3a83-aa98-44c7-8984-2f1bf921c759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:55.477675 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e3a83-aa98-44c7-8984-2f1bf921c759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:55.479480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e3a83-aa98-44c7-8984-2f1bf921c759 service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:55.498579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 711/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:56.370393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61788bbf-ffbf-42aa-9ec8-b6cc1371244b None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:56.371103 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61788bbf-ffbf-42aa-9ec8-b6cc1371244b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:56.371103 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61788bbf-ffbf-42aa-9ec8-b6cc1371244b None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:56.372295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:56.377582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dafef-81cf-40f9-9d65-9e954d4b578e None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:56.378135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dafef-81cf-40f9-9d65-9e954d4b578e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:56.378250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dafef-81cf-40f9-9d65-9e954d4b578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:56.398509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:56.460718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-355dafef-81cf-40f9-9d65-9e954d4b578e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:56.461997 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-355dafef-81cf-40f9-9d65-9e954d4b578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:56.561555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:56.711777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61788bbf-ffbf-42aa-9ec8-b6cc1371244b None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:56.713301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-61788bbf-ffbf-42aa-9ec8-b6cc1371244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:56.827754 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:56.865519 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61788bbf-ffbf-42aa-9ec8-b6cc1371244b None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:56.982486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ebe31-c673-4a2d-a923-ac6e4c22bac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:56.983019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ebe31-c673-4a2d-a923-ac6e4c22bac1 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:56.983297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ebe31-c673-4a2d-a923-ac6e4c22bac1 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:56.983568 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ebe31-c673-4a2d-a923-ac6e4c22bac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:56.985224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4e1ebe31-c673-4a2d-a923-ac6e4c22bac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:57.066779 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:57.081626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ebe31-c673-4a2d-a923-ac6e4c22bac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:57.083244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ebe31-c673-4a2d-a923-ac6e4c22bac1 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:57.102769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 713/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:57.994237 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61ab1e-f536-42ff-9b5e-cd72f62d31ff None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:57.994825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61ab1e-f536-42ff-9b5e-cd72f62d31ff None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:57.994825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61ab1e-f536-42ff-9b5e-cd72f62d31ff None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:57.996141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:58.001440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6ac89-9139-4083-808d-6fe232214e94 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:58.001927 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6ac89-9139-4083-808d-6fe232214e94 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:58.002049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6ac89-9139-4083-808d-6fe232214e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:58.078537 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-fcc6ac89-9139-4083-808d-6fe232214e94 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:58.079764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-fcc6ac89-9139-4083-808d-6fe232214e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:58.182059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:58.334333 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61ab1e-f536-42ff-9b5e-cd72f62d31ff None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:58.335764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ff61ab1e-f536-42ff-9b5e-cd72f62d31ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:58.423378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:58.488485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61ab1e-f536-42ff-9b5e-cd72f62d31ff None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:16:58.612664 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848de3b0-9fc1-48cb-b934-e0684638c994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:16:58.613169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848de3b0-9fc1-48cb-b934-e0684638c994 service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:58.613445 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848de3b0-9fc1-48cb-b934-e0684638c994 service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:58.613717 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848de3b0-9fc1-48cb-b934-e0684638c994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:58.615386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-848de3b0-9fc1-48cb-b934-e0684638c994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:58.666516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:16:58.713259 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848de3b0-9fc1-48cb-b934-e0684638c994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:16:58.714983 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848de3b0-9fc1-48cb-b934-e0684638c994 service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:16:58.736872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 714/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:16:59.556969 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6c93a-cdc6-4bc4-bc3d-6a2b2617c58b None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:59.557476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6c93a-cdc6-4bc4-bc3d-6a2b2617c58b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:59.557476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6c93a-cdc6-4bc4-bc3d-6a2b2617c58b None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:59.558871 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:16:59.564100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ead67c-308d-422f-b7bd-bdc4df63b866 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:16:59.564599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ead67c-308d-422f-b7bd-bdc4df63b866 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:16:59.564704 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ead67c-308d-422f-b7bd-bdc4df63b866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:16:59.643272 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-e8ead67c-308d-422f-b7bd-bdc4df63b866 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:16:59.644601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e8ead67c-308d-422f-b7bd-bdc4df63b866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:59.753265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:16:59.910245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6c93a-cdc6-4bc4-bc3d-6a2b2617c58b None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:16:59.911717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-44a6c93a-cdc6-4bc4-bc3d-6a2b2617c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:16:59.961650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:00.058385 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6c93a-cdc6-4bc4-bc3d-6a2b2617c58b None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:00.173682 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fa5fe-bd41-414f-9638-8839a5dc9dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:00.174237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fa5fe-bd41-414f-9638-8839a5dc9dfe service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:00.174516 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fa5fe-bd41-414f-9638-8839a5dc9dfe service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:00.174787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fa5fe-bd41-414f-9638-8839a5dc9dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:00.176438 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-682fa5fe-bd41-414f-9638-8839a5dc9dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:00.183759 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:00.268940 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fa5fe-bd41-414f-9638-8839a5dc9dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:00.270612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fa5fe-bd41-414f-9638-8839a5dc9dfe service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:00.289069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 716/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:17:01.107607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57c71d-2758-4d81-b8df-505baf91e29e None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:01.108164 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57c71d-2758-4d81-b8df-505baf91e29e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:01.108164 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57c71d-2758-4d81-b8df-505baf91e29e None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:01.109529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:01.114531 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a317c8-c75e-4dd5-89c9-ba723da7c3bb None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:01.115033 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a317c8-c75e-4dd5-89c9-ba723da7c3bb None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:01.115131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a317c8-c75e-4dd5-89c9-ba723da7c3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:01.194277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-57a317c8-c75e-4dd5-89c9-ba723da7c3bb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:01.195522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-57a317c8-c75e-4dd5-89c9-ba723da7c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:01.267390 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:01.299877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:01.451378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57c71d-2758-4d81-b8df-505baf91e29e None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:01.453665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3c57c71d-2758-4d81-b8df-505baf91e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:01.472148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:01.607785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57c71d-2758-4d81-b8df-505baf91e29e None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:01.700027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:01.734537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6d0d8-e2fe-422e-b504-b5e202aac900 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:01.735159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6d0d8-e2fe-422e-b504-b5e202aac900 service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:01.735446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6d0d8-e2fe-422e-b504-b5e202aac900 service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:01.735721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6d0d8-e2fe-422e-b504-b5e202aac900 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:01.737374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-52c6d0d8-e2fe-422e-b504-b5e202aac900 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:01.831303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6d0d8-e2fe-422e-b504-b5e202aac900 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:01.832945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6d0d8-e2fe-422e-b504-b5e202aac900 service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:01.857394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 717/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:02.684772 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc7126-555e-4bd7-9527-1220f0e78dbe None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:02.685336 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc7126-555e-4bd7-9527-1220f0e78dbe None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:02.685336 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc7126-555e-4bd7-9527-1220f0e78dbe None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:02.686724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:02.694319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e3b62-39e7-44f4-a957-3ef9e0d53bba None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:02.694843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e3b62-39e7-44f4-a957-3ef9e0d53bba None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:02.694843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e3b62-39e7-44f4-a957-3ef9e0d53bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:02.779867 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-c36e3b62-39e7-44f4-a957-3ef9e0d53bba None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:02.781396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c36e3b62-39e7-44f4-a957-3ef9e0d53bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:02.829455 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:02.887407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:03.043616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc7126-555e-4bd7-9527-1220f0e78dbe None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:03.045070 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-67dc7126-555e-4bd7-9527-1220f0e78dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:03.198575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc7126-555e-4bd7-9527-1220f0e78dbe None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:03.254925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:03.315731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06131b-1bf7-4649-8a15-fb95e5a1801d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:03.316264 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06131b-1bf7-4649-8a15-fb95e5a1801d service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:03.316546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06131b-1bf7-4649-8a15-fb95e5a1801d service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:03.316823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06131b-1bf7-4649-8a15-fb95e5a1801d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:03.318528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ed06131b-1bf7-4649-8a15-fb95e5a1801d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:03.411696 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06131b-1bf7-4649-8a15-fb95e5a1801d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:03.413296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06131b-1bf7-4649-8a15-fb95e5a1801d service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:03.432489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 719/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:04.262590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c956ddd-09e0-4eca-b6ea-76e191766958 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:04.263208 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c956ddd-09e0-4eca-b6ea-76e191766958 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:04.263208 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c956ddd-09e0-4eca-b6ea-76e191766958 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:04.264507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:04.270352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad469ec0-4f9a-449c-83c8-1349d1fdd801 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:04.270975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad469ec0-4f9a-449c-83c8-1349d1fdd801 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:04.270975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad469ec0-4f9a-449c-83c8-1349d1fdd801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:04.350537 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-ad469ec0-4f9a-449c-83c8-1349d1fdd801 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:04.352359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ad469ec0-4f9a-449c-83c8-1349d1fdd801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:04.355672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:04.460798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:04.613936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c956ddd-09e0-4eca-b6ea-76e191766958 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:04.615417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5c956ddd-09e0-4eca-b6ea-76e191766958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:04.765936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c956ddd-09e0-4eca-b6ea-76e191766958 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:04.801048 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:04.903322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fbaa7-ce10-45a5-8fd2-cd1d8ff6dc04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:04.903845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fbaa7-ce10-45a5-8fd2-cd1d8ff6dc04 service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:04.904126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fbaa7-ce10-45a5-8fd2-cd1d8ff6dc04 service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:04.904401 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fbaa7-ce10-45a5-8fd2-cd1d8ff6dc04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:04.906375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b76fbaa7-ce10-45a5-8fd2-cd1d8ff6dc04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:04.998713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fbaa7-ce10-45a5-8fd2-cd1d8ff6dc04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:05.001084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fbaa7-ce10-45a5-8fd2-cd1d8ff6dc04 service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:05.020985 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 720/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:06.963492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c866a57-c6d5-4f8b-aa2d-177b8c603008 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:06.964106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c866a57-c6d5-4f8b-aa2d-177b8c603008 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:06.964106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c866a57-c6d5-4f8b-aa2d-177b8c603008 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:06.965415 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:06.971441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46f33-8b9c-45c2-80c5-0bb9db88bc14 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:06.971939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46f33-8b9c-45c2-80c5-0bb9db88bc14 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:06.972044 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f46f33-8b9c-45c2-80c5-0bb9db88bc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:07.014088 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:07.042137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-f0f46f33-8b9c-45c2-80c5-0bb9db88bc14 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:07.043359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f0f46f33-8b9c-45c2-80c5-0bb9db88bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:07.142922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:07.181949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c866a57-c6d5-4f8b-aa2d-177b8c603008 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:07.183502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0c866a57-c6d5-4f8b-aa2d-177b8c603008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:07.289342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c866a57-c6d5-4f8b-aa2d-177b8c603008 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:07.322452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:07.366249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4f241-39b8-4ae6-961c-34e8834368e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:07.366868 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4f241-39b8-4ae6-961c-34e8834368e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:07.367140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4f241-39b8-4ae6-961c-34e8834368e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:07.367407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4f241-39b8-4ae6-961c-34e8834368e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:07.369047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c9b4f241-39b8-4ae6-961c-34e8834368e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:07.485570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4f241-39b8-4ae6-961c-34e8834368e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:07.487074 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4f241-39b8-4ae6-961c-34e8834368e2 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:07.505818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 722/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:09.768637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709beb4d-0d9d-4ecd-b49f-668664510daa None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:09.769256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709beb4d-0d9d-4ecd-b49f-668664510daa None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:09.769256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709beb4d-0d9d-4ecd-b49f-668664510daa None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:09.770889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:09.777181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebcc3f-f0ee-4e03-9725-ce822aaa0a04 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:09.777727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebcc3f-f0ee-4e03-9725-ce822aaa0a04 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:09.777727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebcc3f-f0ee-4e03-9725-ce822aaa0a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:09.850472 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6bebcc3f-f0ee-4e03-9725-ce822aaa0a04 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:09.851717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6bebcc3f-f0ee-4e03-9725-ce822aaa0a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:09.865651 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:09.955967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:09.994270 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709beb4d-0d9d-4ecd-b49f-668664510daa None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:09.995913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-709beb4d-0d9d-4ecd-b49f-668664510daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:10.101311 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709beb4d-0d9d-4ecd-b49f-668664510daa None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:10.114129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:10.178800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a1d39e-b769-4a7c-846e-cc73a859dd49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:10.179428 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1d39e-b769-4a7c-846e-cc73a859dd49 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:10.179712 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1d39e-b769-4a7c-846e-cc73a859dd49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:10.179987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a1d39e-b769-4a7c-846e-cc73a859dd49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:10.181650 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e0a1d39e-b769-4a7c-846e-cc73a859dd49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:10.294860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a1d39e-b769-4a7c-846e-cc73a859dd49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:10.296322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a1d39e-b769-4a7c-846e-cc73a859dd49 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:10.317172 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 723/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:12.654389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072335a0-1473-4b68-a52e-3e21befab2ca None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:12.654916 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072335a0-1473-4b68-a52e-3e21befab2ca None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:12.654916 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072335a0-1473-4b68-a52e-3e21befab2ca None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:12.657020 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:12.662622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcb8fe-5e17-434a-a2c5-dddab1e9ef72 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:12.663091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcb8fe-5e17-434a-a2c5-dddab1e9ef72 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:12.663204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcb8fe-5e17-434a-a2c5-dddab1e9ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:12.713300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:12.732854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-f4fcb8fe-5e17-434a-a2c5-dddab1e9ef72 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:12.734695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f4fcb8fe-5e17-434a-a2c5-dddab1e9ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:12.840226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:12.882147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072335a0-1473-4b68-a52e-3e21befab2ca None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:12.883719 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-072335a0-1473-4b68-a52e-3e21befab2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:12.993002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072335a0-1473-4b68-a52e-3e21befab2ca None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:13.034692 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:13.071843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856c984-c4a0-4d0a-b6c8-1d5691f09172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:13.072468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856c984-c4a0-4d0a-b6c8-1d5691f09172 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:13.072745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856c984-c4a0-4d0a-b6c8-1d5691f09172 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:13.073019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856c984-c4a0-4d0a-b6c8-1d5691f09172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:13.074728 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2856c984-c4a0-4d0a-b6c8-1d5691f09172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:13.197023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856c984-c4a0-4d0a-b6c8-1d5691f09172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:13.198490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856c984-c4a0-4d0a-b6c8-1d5691f09172 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:13.216984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 725/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:15.395168 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbce6e3-3e99-41d1-b2d1-4ee6a758f126 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:15.395736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbce6e3-3e99-41d1-b2d1-4ee6a758f126 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:15.395736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbce6e3-3e99-41d1-b2d1-4ee6a758f126 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:15.397100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:15.402968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e9455-c7ec-4f54-9c2a-528700a25f4f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:15.403432 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e9455-c7ec-4f54-9c2a-528700a25f4f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:15.403534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e9455-c7ec-4f54-9c2a-528700a25f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:15.474789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-5c5e9455-c7ec-4f54-9c2a-528700a25f4f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:15.476028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-5c5e9455-c7ec-4f54-9c2a-528700a25f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:15.497269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:15.579314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:15.619123 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbce6e3-3e99-41d1-b2d1-4ee6a758f126 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:15.620801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fdbce6e3-3e99-41d1-b2d1-4ee6a758f126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:15.728458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbce6e3-3e99-41d1-b2d1-4ee6a758f126 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:15.749121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:15.807170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a55abb-f7ba-4b23-9d5c-a8810f96b146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:15.807795 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55abb-f7ba-4b23-9d5c-a8810f96b146 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:15.808101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55abb-f7ba-4b23-9d5c-a8810f96b146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:15.808381 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a55abb-f7ba-4b23-9d5c-a8810f96b146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:15.810133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f4a55abb-f7ba-4b23-9d5c-a8810f96b146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:15.939563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a55abb-f7ba-4b23-9d5c-a8810f96b146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:15.941017 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a55abb-f7ba-4b23-9d5c-a8810f96b146 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:15.963868 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 726/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:18.114349 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb994-4706-4e1f-9cfe-9439be70fc77 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:18.114903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb994-4706-4e1f-9cfe-9439be70fc77 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:18.114903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb994-4706-4e1f-9cfe-9439be70fc77 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:18.116275 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:17:18.121952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df104de0-f616-4ca0-abc2-32b487386ec2 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:18.122487 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df104de0-f616-4ca0-abc2-32b487386ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:18.122593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df104de0-f616-4ca0-abc2-32b487386ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:18.188422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:18.191324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-df104de0-f616-4ca0-abc2-32b487386ec2 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:18.193112 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-df104de0-f616-4ca0-abc2-32b487386ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:18.298231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:18.336512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcb994-4706-4e1f-9cfe-9439be70fc77 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:18.338090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e8dcb994-4706-4e1f-9cfe-9439be70fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:18.444284 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcb994-4706-4e1f-9cfe-9439be70fc77 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:18.503642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:18.529091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85f629-8a44-46d5-8830-1dd9383ee096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:18.530502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85f629-8a44-46d5-8830-1dd9383ee096 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:18.530774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85f629-8a44-46d5-8830-1dd9383ee096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:18.531048 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85f629-8a44-46d5-8830-1dd9383ee096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:18.532923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2d85f629-8a44-46d5-8830-1dd9383ee096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:18.655903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85f629-8a44-46d5-8830-1dd9383ee096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:18.657550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85f629-8a44-46d5-8830-1dd9383ee096 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:18.676898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 728/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:20.775298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224c708-fb14-4ebb-82f8-36e4c1fd205c None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:20.775851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224c708-fb14-4ebb-82f8-36e4c1fd205c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:20.775851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224c708-fb14-4ebb-82f8-36e4c1fd205c None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:20.777244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:20.782993 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b4a5b-f3b9-4847-8f17-5611c69213c2 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:20.783491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b4a5b-f3b9-4847-8f17-5611c69213c2 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:20.783603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b4a5b-f3b9-4847-8f17-5611c69213c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:20.852951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-9e2b4a5b-f3b9-4847-8f17-5611c69213c2 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:20.854213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9e2b4a5b-f3b9-4847-8f17-5611c69213c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:20.883479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:20.955577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:20.992863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224c708-fb14-4ebb-82f8-36e4c1fd205c None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:20.994547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d224c708-fb14-4ebb-82f8-36e4c1fd205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:21.104791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224c708-fb14-4ebb-82f8-36e4c1fd205c None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:21.136259 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:21.184048 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c371f-87f0-4483-9948-0d774649dd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:21.184669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c371f-87f0-4483-9948-0d774649dd08 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:21.184953 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c371f-87f0-4483-9948-0d774649dd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:21.185235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c371f-87f0-4483-9948-0d774649dd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:21.187559 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9e2c371f-87f0-4483-9948-0d774649dd08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:21.301045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c371f-87f0-4483-9948-0d774649dd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:21.302569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c371f-87f0-4483-9948-0d774649dd08 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:21.321658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 729/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:23.425962 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a3101-1763-4fa0-8357-33221ef0503c None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:23.426717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a3101-1763-4fa0-8357-33221ef0503c None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:23.426717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a3101-1763-4fa0-8357-33221ef0503c None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:23.427912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:23.433501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52beaa-0666-4502-ae8c-50957583cad1 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:23.433953 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52beaa-0666-4502-ae8c-50957583cad1 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:23.434099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52beaa-0666-4502-ae8c-50957583cad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:23.502086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-5d52beaa-0666-4502-ae8c-50957583cad1 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:23.503325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5d52beaa-0666-4502-ae8c-50957583cad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:23.512078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:23.608371 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:23.645773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a3101-1763-4fa0-8357-33221ef0503c None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:23.647506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d49a3101-1763-4fa0-8357-33221ef0503c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:23.756547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a3101-1763-4fa0-8357-33221ef0503c None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:23.813149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:23.834959 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7447bca-98e0-4f29-a073-e5a64adf4ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:23.835575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447bca-98e0-4f29-a073-e5a64adf4ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:23.835890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447bca-98e0-4f29-a073-e5a64adf4ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:23.836252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447bca-98e0-4f29-a073-e5a64adf4ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:23.838140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b7447bca-98e0-4f29-a073-e5a64adf4ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:23.960978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7447bca-98e0-4f29-a073-e5a64adf4ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:23.962445 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7447bca-98e0-4f29-a073-e5a64adf4ff0 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:23.981246 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 731/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:26.039341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8a04-fee1-44eb-8611-0526bdad5a63 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:26.039925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8a04-fee1-44eb-8611-0526bdad5a63 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:26.039925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8a04-fee1-44eb-8611-0526bdad5a63 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:26.041236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:26.047248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a33f24-78d4-4bbd-b52a-009ef0de24a7 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:26.047778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a33f24-78d4-4bbd-b52a-009ef0de24a7 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:26.047778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a33f24-78d4-4bbd-b52a-009ef0de24a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:26.122427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-67a33f24-78d4-4bbd-b52a-009ef0de24a7 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:26.123676 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-67a33f24-78d4-4bbd-b52a-009ef0de24a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:26.163324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:26.222877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:26.259893 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8a04-fee1-44eb-8611-0526bdad5a63 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:26.261434 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b41e8a04-fee1-44eb-8611-0526bdad5a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:26.368845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8a04-fee1-44eb-8611-0526bdad5a63 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:26.408562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:26.445407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c395c56-aba8-4522-ae81-f3b36d14cc57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:26.446052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c395c56-aba8-4522-ae81-f3b36d14cc57 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:26.446341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c395c56-aba8-4522-ae81-f3b36d14cc57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:26.446620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c395c56-aba8-4522-ae81-f3b36d14cc57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:26.448292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1c395c56-aba8-4522-ae81-f3b36d14cc57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:26.564623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c395c56-aba8-4522-ae81-f3b36d14cc57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:26.566122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c395c56-aba8-4522-ae81-f3b36d14cc57 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:26.585206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 732/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:28.625372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38885ea3-2a4c-488a-9a2f-1b65ce68f441 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:28.626141 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38885ea3-2a4c-488a-9a2f-1b65ce68f441 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:28.626141 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38885ea3-2a4c-488a-9a2f-1b65ce68f441 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:28.627362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:28.632832 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b96dcd-9ded-4b08-bf1a-8fac857e69a0 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:28.633344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b96dcd-9ded-4b08-bf1a-8fac857e69a0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:28.633459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b96dcd-9ded-4b08-bf1a-8fac857e69a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:28.702203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-59b96dcd-9ded-4b08-bf1a-8fac857e69a0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:28.703434 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-59b96dcd-9ded-4b08-bf1a-8fac857e69a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:28.721965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:28.801433 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:28.837990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38885ea3-2a4c-488a-9a2f-1b65ce68f441 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:28.839585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-38885ea3-2a4c-488a-9a2f-1b65ce68f441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:28.945875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38885ea3-2a4c-488a-9a2f-1b65ce68f441 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:29.016776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:29.024268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabd376-2bd3-4703-b824-6ac0f2d755fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:29.024892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabd376-2bd3-4703-b824-6ac0f2d755fb service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:29.025174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabd376-2bd3-4703-b824-6ac0f2d755fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:29.025451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabd376-2bd3-4703-b824-6ac0f2d755fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:29.027148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9aabd376-2bd3-4703-b824-6ac0f2d755fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:29.141974 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabd376-2bd3-4703-b824-6ac0f2d755fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:29.143445 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabd376-2bd3-4703-b824-6ac0f2d755fb service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:29.162131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 734/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:31.203697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b0a6f-56c2-4caf-bec1-6820fbe3b17a None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:31.204285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b0a6f-56c2-4caf-bec1-6820fbe3b17a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:31.204285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b0a6f-56c2-4caf-bec1-6820fbe3b17a None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:31.205642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:17:31.211226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486a7a-486a-493f-807f-5599e01a1062 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:31.211707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486a7a-486a-493f-807f-5599e01a1062 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:31.211806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28486a7a-486a-493f-807f-5599e01a1062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:31.280821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-28486a7a-486a-493f-807f-5599e01a1062 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:31.282242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-28486a7a-486a-493f-807f-5599e01a1062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:31.335843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:31.387217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:31.424533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b0a6f-56c2-4caf-bec1-6820fbe3b17a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:31.426160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-727b0a6f-56c2-4caf-bec1-6820fbe3b17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:31.533156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b0a6f-56c2-4caf-bec1-6820fbe3b17a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:31.580599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:31.611194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6bbde-a092-4d82-a368-33485d00a80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:31.611814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6bbde-a092-4d82-a368-33485d00a80e service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:31.612097 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6bbde-a092-4d82-a368-33485d00a80e service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:31.612371 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6bbde-a092-4d82-a368-33485d00a80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:31.614054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-84e6bbde-a092-4d82-a368-33485d00a80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:31.725846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6bbde-a092-4d82-a368-33485d00a80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:31.727335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e6bbde-a092-4d82-a368-33485d00a80e service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:31.745701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 735/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:41.385385 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=22 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:41.743355 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=66 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:51.538956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8850654-de37-40b0-b1d7-e72582284f7b None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:51.539541 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8850654-de37-40b0-b1d7-e72582284f7b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:51.539541 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8850654-de37-40b0-b1d7-e72582284f7b None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:51.540951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 736/1471] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:51.546203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2435b-e6bb-4f85-a4df-d861bc85bb27 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:51.546645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2435b-e6bb-4f85-a4df-d861bc85bb27 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:51.546744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2435b-e6bb-4f85-a4df-d861bc85bb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:51.615839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-12a2435b-e6bb-4f85-a4df-d861bc85bb27 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:51.616991 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-12a2435b-e6bb-4f85-a4df-d861bc85bb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:51.715811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 736/1472] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:51.801642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9c7d-3151-43a8-aa5d-baf87bd2e8bc None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:51.801932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9c7d-3151-43a8-aa5d-baf87bd2e8bc None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:51.802250 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c9c7d-3151-43a8-aa5d-baf87bd2e8bc None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:51.803690 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 737/1473] 10.222.0.57 () {54 vars in 966 bytes} [Tue Aug 2 08:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:51.808763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9c879-56fc-4141-a5e8-6a9cbaa48319 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:51.813595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9c879-56fc-4141-a5e8-6a9cbaa48319 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:51.813903 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9c879-56fc-4141-a5e8-6a9cbaa48319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:51.891702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-65d9c879-56fc-4141-a5e8-6a9cbaa48319 None None] MFA Rules not processed for user `739b8f31f1d74459a7348c3ed699812c`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:51.892838 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-65d9c879-56fc-4141-a5e8-6a9cbaa48319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:51.913853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:51.970464 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 737/1474] 10.222.0.57 () {58 vars in 1063 bytes} [Tue Aug 2 08:17:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:51.978217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c9c7d-3151-43a8-aa5d-baf87bd2e8bc None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:51.979742 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-780c9c7d-3151-43a8-aa5d-baf87bd2e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:52.084238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c9c7d-3151-43a8-aa5d-baf87bd2e8bc None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:52.159185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77d633-1904-4a25-9003-fe060c580477 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '739b8f31f1d74459a7348c3ed699812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:52.159627 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77d633-1904-4a25-9003-fe060c580477 service glance] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:52.159936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77d633-1904-4a25-9003-fe060c580477 service glance] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:52.160205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77d633-1904-4a25-9003-fe060c580477 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:52.161839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-be77d633-1904-4a25-9003-fe060c580477 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:52.219796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:52.276475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77d633-1904-4a25-9003-fe060c580477 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:52.278464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77d633-1904-4a25-9003-fe060c580477 service glance] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:52.298750 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 738/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:54.439143 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a5098-d0d1-4a86-a8a3-a957221a8596 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:54.439999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a5098-d0d1-4a86-a8a3-a957221a8596 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:54.439999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a5098-d0d1-4a86-a8a3-a957221a8596 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:54.441347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 738/1476] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:54.446863 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23ee09-b586-4723-b6df-09bff2f962bd None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:54.447339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23ee09-b586-4723-b6df-09bff2f962bd None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:54.447452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23ee09-b586-4723-b6df-09bff2f962bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:54.537324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-0b23ee09-b586-4723-b6df-09bff2f962bd None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:54.538580 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0b23ee09-b586-4723-b6df-09bff2f962bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:54.638591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 739/1477] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:54.661716 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a5098-d0d1-4a86-a8a3-a957221a8596 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:54.663300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e30a5098-d0d1-4a86-a8a3-a957221a8596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:54.809626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a5098-d0d1-4a86-a8a3-a957221a8596 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:54.861076 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:54.907830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49083c-cab9-4f70-98ad-4a960b189fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:54.908362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49083c-cab9-4f70-98ad-4a960b189fde admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:54.908645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49083c-cab9-4f70-98ad-4a960b189fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:54.908921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49083c-cab9-4f70-98ad-4a960b189fde admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:54.909626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49083c-cab9-4f70-98ad-4a960b189fde admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:54.911482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: WARNING py.warnings [None req-8e49083c-cab9-4f70-98ad-4a960b189fde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:17:54.911482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: warnings.warn(msg) Aug 02 08:17:54.911482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: Aug 02 08:17:54.912652 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49083c-cab9-4f70-98ad-4a960b189fde admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:54.933784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 739/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 08:17:54 2022] GET /identity/v3/projects => generated 2553 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:17:56.995666 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2329-38eb-4501-aa3a-da18d44f9ddf None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:56.996246 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2329-38eb-4501-aa3a-da18d44f9ddf None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:56.996246 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2329-38eb-4501-aa3a-da18d44f9ddf None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:56.997625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 740/1479] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:57.003035 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ea116-1a64-4d5e-a545-4ee152b099b9 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:57.003496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ea116-1a64-4d5e-a545-4ee152b099b9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:57.003607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ea116-1a64-4d5e-a545-4ee152b099b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:57.070297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-e22ea116-1a64-4d5e-a545-4ee152b099b9 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:57.071524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e22ea116-1a64-4d5e-a545-4ee152b099b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:57.175388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 740/1480] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:17:57.220015 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef2329-38eb-4501-aa3a-da18d44f9ddf None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:17:57.221626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-f5ef2329-38eb-4501-aa3a-da18d44f9ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:57.231762 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:57.399414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef2329-38eb-4501-aa3a-da18d44f9ddf None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:17:57.491918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:17:57.528154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b747d28-e1e9-4b73-b0a9-cf2a27ac9062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:17:57.529035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b747d28-e1e9-4b73-b0a9-cf2a27ac9062 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:57.529311 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b747d28-e1e9-4b73-b0a9-cf2a27ac9062 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:57.529588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b747d28-e1e9-4b73-b0a9-cf2a27ac9062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:57.531257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7b747d28-e1e9-4b73-b0a9-cf2a27ac9062 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:17:57.623671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b747d28-e1e9-4b73-b0a9-cf2a27ac9062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:17:57.625171 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b747d28-e1e9-4b73-b0a9-cf2a27ac9062 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:17:57.644112 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 741/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:17:59.885357 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1ec29-0580-4f05-8c3f-a638dce87dd7 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:59.885964 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1ec29-0580-4f05-8c3f-a638dce87dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:59.885964 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1ec29-0580-4f05-8c3f-a638dce87dd7 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:59.887315 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 741/1482] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:17:59.892721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0480f-271d-41c3-b375-34a83fb36440 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:17:59.893140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0480f-271d-41c3-b375-34a83fb36440 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:17:59.893276 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0480f-271d-41c3-b375-34a83fb36440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:17:59.961847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-4aa0480f-271d-41c3-b375-34a83fb36440 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:17:59.963107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4aa0480f-271d-41c3-b375-34a83fb36440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:00.019664 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:00.070508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 742/1483] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:18:00.107834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1ec29-0580-4f05-8c3f-a638dce87dd7 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:18:00.109380 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fed1ec29-0580-4f05-8c3f-a638dce87dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:00.132624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:00.212799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1ec29-0580-4f05-8c3f-a638dce87dd7 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:18:00.286556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e01bb6-8f1f-4263-80ae-690b7c98778a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:18:00.287174 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e01bb6-8f1f-4263-80ae-690b7c98778a service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:18:00.287455 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e01bb6-8f1f-4263-80ae-690b7c98778a service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:18:00.287732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e01bb6-8f1f-4263-80ae-690b7c98778a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:18:00.289374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-36e01bb6-8f1f-4263-80ae-690b7c98778a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:00.365113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:00.400470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e01bb6-8f1f-4263-80ae-690b7c98778a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:18:00.401909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e01bb6-8f1f-4263-80ae-690b7c98778a service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:18:00.421035 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 742/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:18:02.489487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570fcee-170a-411a-9c5b-b3d7824b6a10 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:18:02.490076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570fcee-170a-411a-9c5b-b3d7824b6a10 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:18:02.490076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570fcee-170a-411a-9c5b-b3d7824b6a10 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:18:02.491450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 743/1485] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:18:02.497302 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da607c-1f56-4290-b838-7d10ead29d91 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:18:02.497725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da607c-1f56-4290-b838-7d10ead29d91 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:18:02.497944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da607c-1f56-4290-b838-7d10ead29d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:18:02.686443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-49da607c-1f56-4290-b838-7d10ead29d91 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:18:02.687666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-49da607c-1f56-4290-b838-7d10ead29d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:02.784738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 743/1486] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:18:02.823437 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570fcee-170a-411a-9c5b-b3d7824b6a10 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:18:02.825039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b570fcee-170a-411a-9c5b-b3d7824b6a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:02.927872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570fcee-170a-411a-9c5b-b3d7824b6a10 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:18:02.999887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:03.001911 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8876f-36db-481f-acdd-3ae1f58a0a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:18:03.002683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8876f-36db-481f-acdd-3ae1f58a0a62 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:18:03.003248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8876f-36db-481f-acdd-3ae1f58a0a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:18:03.003740 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8876f-36db-481f-acdd-3ae1f58a0a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:18:03.005672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-99e8876f-36db-481f-acdd-3ae1f58a0a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:03.113127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8876f-36db-481f-acdd-3ae1f58a0a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:18:03.114573 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8876f-36db-481f-acdd-3ae1f58a0a62 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:18:03.132841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 744/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:18:05.253870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acbc5b-566b-4efa-928e-b1d9376721d0 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:18:05.254490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acbc5b-566b-4efa-928e-b1d9376721d0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:18:05.254490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acbc5b-566b-4efa-928e-b1d9376721d0 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:18:05.255885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 744/1488] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:18:05.261142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627dfd0-1912-46eb-bb0c-d80a0906e6b2 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:18:05.261552 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627dfd0-1912-46eb-bb0c-d80a0906e6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:18:05.261699 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627dfd0-1912-46eb-bb0c-d80a0906e6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:18:05.330655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3627dfd0-1912-46eb-bb0c-d80a0906e6b2 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:18:05.331859 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3627dfd0-1912-46eb-bb0c-d80a0906e6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:05.384609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:05.428860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 745/1489] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:18:05.470059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acbc5b-566b-4efa-928e-b1d9376721d0 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:18:05.471591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-13acbc5b-566b-4efa-928e-b1d9376721d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:05.518197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:05.586303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acbc5b-566b-4efa-928e-b1d9376721d0 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:18:05.660489 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e5f29-187f-43c1-b81a-d06bde277d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:18:05.661104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5f29-187f-43c1-b81a-d06bde277d20 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:18:05.661376 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5f29-187f-43c1-b81a-d06bde277d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:18:05.661643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e5f29-187f-43c1-b81a-d06bde277d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:18:05.663296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4e4e5f29-187f-43c1-b81a-d06bde277d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:05.742836 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:05.771454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e5f29-187f-43c1-b81a-d06bde277d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:18:05.772817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e5f29-187f-43c1-b81a-d06bde277d20 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:18:05.791028 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 745/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:18:07.991180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d8942-4afb-4712-ac36-0c2528d7e8fb None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:18:07.991733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d8942-4afb-4712-ac36-0c2528d7e8fb None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:18:07.991733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d8942-4afb-4712-ac36-0c2528d7e8fb None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:18:07.993114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 746/1491] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 08:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:18:07.998852 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f01a7-8362-417f-8198-e991b9b7e58e None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:18:07.999259 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f01a7-8362-417f-8198-e991b9b7e58e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:18:07.999398 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f01a7-8362-417f-8198-e991b9b7e58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:18:08.068350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-550f01a7-8362-417f-8198-e991b9b7e58e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:18:08.069601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-550f01a7-8362-417f-8198-e991b9b7e58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:08.164869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 746/1492] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 08:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:18:08.204021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d8942-4afb-4712-ac36-0c2528d7e8fb None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:18:08.206307 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-392d8942-4afb-4712-ac36-0c2528d7e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:08.310471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d8942-4afb-4712-ac36-0c2528d7e8fb None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:18:08.384935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b0a42-9531-40ff-afdf-39455e52b241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:18:08.385551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b0a42-9531-40ff-afdf-39455e52b241 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:18:08.385827 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b0a42-9531-40ff-afdf-39455e52b241 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:18:08.386130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b0a42-9531-40ff-afdf-39455e52b241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:18:08.387782 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-433b0a42-9531-40ff-afdf-39455e52b241 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:18:08.396780 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:08.494679 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b0a42-9531-40ff-afdf-39455e52b241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:18:08.496088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b0a42-9531-40ff-afdf-39455e52b241 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:18:08.514771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 747/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:18:18.163061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=82 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:18:18.512617 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=50 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:36.808263 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647430f-45d0-490d-93a2-7b632a25d743 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:36.808869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647430f-45d0-490d-93a2-7b632a25d743 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:36.809121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647430f-45d0-490d-93a2-7b632a25d743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:36.885194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-9647430f-45d0-490d-93a2-7b632a25d743 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:19:36.886428 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9647430f-45d0-490d-93a2-7b632a25d743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:36.980669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 747/1494] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:19:36.988775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42e6d-902b-4767-a90c-dd52abefbe90 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:36.989285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42e6d-902b-4767-a90c-dd52abefbe90 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:36.989395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42e6d-902b-4767-a90c-dd52abefbe90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:37.064676 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-54c42e6d-902b-4767-a90c-dd52abefbe90 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:19:37.065808 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-54c42e6d-902b-4767-a90c-dd52abefbe90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:37.160758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 748/1495] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:19:37.165958 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647430f-45d0-490d-93a2-7b632a25d743 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:19:37.167187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9647430f-45d0-490d-93a2-7b632a25d743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:37.178623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647430f-45d0-490d-93a2-7b632a25d743 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:19:37.239687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:37.273409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041368fe-569b-4e7a-9b00-43b87b71e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:19:37.274567 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041368fe-569b-4e7a-9b00-43b87b71e113 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:37.274848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041368fe-569b-4e7a-9b00-43b87b71e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:37.275389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041368fe-569b-4e7a-9b00-43b87b71e113 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:37.276080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041368fe-569b-4e7a-9b00-43b87b71e113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:19:37.276398 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041368fe-569b-4e7a-9b00-43b87b71e113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:19:37.277407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: WARNING py.warnings [None req-041368fe-569b-4e7a-9b00-43b87b71e113 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:19:37.277407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: warnings.warn(msg) Aug 02 08:19:37.277407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: Aug 02 08:19:37.278311 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041368fe-569b-4e7a-9b00-43b87b71e113 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:19:37.290173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 748/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:19:37.298411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c42e6d-902b-4767-a90c-dd52abefbe90 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:19:37.307902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c42e6d-902b-4767-a90c-dd52abefbe90 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:19:37.375362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:37.410441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02165fe6-35e3-4806-bf55-70bbcd45680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:19:37.411058 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02165fe6-35e3-4806-bf55-70bbcd45680d admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:37.411337 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02165fe6-35e3-4806-bf55-70bbcd45680d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:37.411612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02165fe6-35e3-4806-bf55-70bbcd45680d admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:37.412263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02165fe6-35e3-4806-bf55-70bbcd45680d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:19:37.413977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: WARNING py.warnings [None req-02165fe6-35e3-4806-bf55-70bbcd45680d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:19:37.413977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: warnings.warn(msg) Aug 02 08:19:37.413977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: Aug 02 08:19:37.415883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02165fe6-35e3-4806-bf55-70bbcd45680d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:19:37.470681 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 749/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:19:37 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:19:37.475067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041368fe-569b-4e7a-9b00-43b87b71e113 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:19:37.476617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-041368fe-569b-4e7a-9b00-43b87b71e113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:37.510186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041368fe-569b-4e7a-9b00-43b87b71e113 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:19:37.607544 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013ca1a-1539-47ed-977b-452b9e9935ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:19:37.608167 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013ca1a-1539-47ed-977b-452b9e9935ce admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:37.608450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013ca1a-1539-47ed-977b-452b9e9935ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:37.608725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013ca1a-1539-47ed-977b-452b9e9935ce admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:37.609443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013ca1a-1539-47ed-977b-452b9e9935ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:19:37.610436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: WARNING py.warnings [None req-9013ca1a-1539-47ed-977b-452b9e9935ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:19:37.610436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: warnings.warn(msg) Aug 02 08:19:37.610436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: Aug 02 08:19:37.611634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013ca1a-1539-47ed-977b-452b9e9935ce admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:19:37.658599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 749/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:19:37 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:19:37.662596 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02165fe6-35e3-4806-bf55-70bbcd45680d admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:19:37.664170 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-02165fe6-35e3-4806-bf55-70bbcd45680d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:37.727125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02165fe6-35e3-4806-bf55-70bbcd45680d admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:19:37.813778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:37.826873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38549cca-a67c-49a9-ae5b-a9afa3d749e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:19:37.827500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38549cca-a67c-49a9-ae5b-a9afa3d749e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:37.827777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38549cca-a67c-49a9-ae5b-a9afa3d749e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:37.828049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38549cca-a67c-49a9-ae5b-a9afa3d749e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:37.828757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38549cca-a67c-49a9-ae5b-a9afa3d749e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:19:37.829752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: WARNING py.warnings [None req-38549cca-a67c-49a9-ae5b-a9afa3d749e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:19:37.829752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: warnings.warn(msg) Aug 02 08:19:37.829752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: Aug 02 08:19:37.830665 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38549cca-a67c-49a9-ae5b-a9afa3d749e8 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:19:37.843884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 750/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:19:37.847965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013ca1a-1539-47ed-977b-452b9e9935ce admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:19:37.849562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9013ca1a-1539-47ed-977b-452b9e9935ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:37.861432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013ca1a-1539-47ed-977b-452b9e9935ce admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:19:37.886869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:37.967563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009c584-b562-4934-a09d-68d6caee1c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:19:37.968206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009c584-b562-4934-a09d-68d6caee1c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:37.968493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009c584-b562-4934-a09d-68d6caee1c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:37.968762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009c584-b562-4934-a09d-68d6caee1c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:37.969480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009c584-b562-4934-a09d-68d6caee1c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:19:37.970606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: WARNING py.warnings [None req-3009c584-b562-4934-a09d-68d6caee1c27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:19:37.970606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: warnings.warn(msg) Aug 02 08:19:37.970606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: Aug 02 08:19:37.971511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009c584-b562-4934-a09d-68d6caee1c27 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:19:37.985904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 750/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:19:37.990335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38549cca-a67c-49a9-ae5b-a9afa3d749e8 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:19:37.992008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-38549cca-a67c-49a9-ae5b-a9afa3d749e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:38.032039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38549cca-a67c-49a9-ae5b-a9afa3d749e8 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:19:38.128565 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83585c4-0ed2-4a03-9a3a-630173e96431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:19:38.129153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83585c4-0ed2-4a03-9a3a-630173e96431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:38.129433 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83585c4-0ed2-4a03-9a3a-630173e96431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:38.129712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83585c4-0ed2-4a03-9a3a-630173e96431 admin admin] PATH_INFO: `/v3/projects/6c8ce8cd6bac4622b8b5294696596128/users/0df2117ea81b4547b96f9d2c4bd3d089/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:38.152892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83585c4-0ed2-4a03-9a3a-630173e96431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8ce8cd6bac4622b8b5294696596128, user_id=0df2117ea81b4547b96f9d2c4bd3d089, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:19:38.153911 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: WARNING py.warnings [None req-f83585c4-0ed2-4a03-9a3a-630173e96431 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:19:38.153911 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: warnings.warn(msg) Aug 02 08:19:38.153911 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: Aug 02 08:19:38.155879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83585c4-0ed2-4a03-9a3a-630173e96431 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:19:38.179360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 751/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:19:37 2022] PUT /identity/v3/projects/6c8ce8cd6bac4622b8b5294696596128/users/0df2117ea81b4547b96f9d2c4bd3d089/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:19:38.192171 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b9e5-f471-4272-9631-fa53ed71669d None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:38.192458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b9e5-f471-4272-9631-fa53ed71669d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:38.192734 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55b9e5-f471-4272-9631-fa53ed71669d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:38.250783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-fc55b9e5-f471-4272-9631-fa53ed71669d None None] MFA Rules not processed for user `0df2117ea81b4547b96f9d2c4bd3d089`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:19:38.251986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fc55b9e5-f471-4272-9631-fa53ed71669d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:38.329577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 751/1502] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:19:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:19:38.344607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699199-2ffb-47aa-b902-269e9d0a7f0c None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:38.344942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699199-2ffb-47aa-b902-269e9d0a7f0c None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:38.345226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2699199-2ffb-47aa-b902-269e9d0a7f0c None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:38.346809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 752/1503] 10.222.0.57 () {54 vars in 964 bytes} [Tue Aug 2 08:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:19:38.351812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b33dd-c5d2-4d92-a8d8-192c16a3dc96 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:38.352198 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b33dd-c5d2-4d92-a8d8-192c16a3dc96 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:38.352808 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b33dd-c5d2-4d92-a8d8-192c16a3dc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:38.384339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:38.429491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-663b33dd-c5d2-4d92-a8d8-192c16a3dc96 None None] MFA Rules not processed for user `6557be84abb6469d95157570517512fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:19:38.431318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-663b33dd-c5d2-4d92-a8d8-192c16a3dc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:38.508359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 752/1504] 10.222.0.57 () {58 vars in 1061 bytes} [Tue Aug 2 08:19:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:19:38.517106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2699199-2ffb-47aa-b902-269e9d0a7f0c None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:19:38.518668 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c2699199-2ffb-47aa-b902-269e9d0a7f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:38.569754 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:38.625959 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2699199-2ffb-47aa-b902-269e9d0a7f0c None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:19:38.702967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5e5d-f449-4516-8fff-5a6db7f64449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:19:38.703594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5e5d-f449-4516-8fff-5a6db7f64449 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:38.703877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5e5d-f449-4516-8fff-5a6db7f64449 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:38.704154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5e5d-f449-4516-8fff-5a6db7f64449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:38.705791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-fcfe5e5d-f449-4516-8fff-5a6db7f64449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:38.805114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe5e5d-f449-4516-8fff-5a6db7f64449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:19:38.806599 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe5e5d-f449-4516-8fff-5a6db7f64449 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:19:38.810235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:38.825148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 753/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:19:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:19:38.870874 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157a0d-6b2b-4e6d-872c-b3752f5a2a1d None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:38.871314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157a0d-6b2b-4e6d-872c-b3752f5a2a1d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:38.871441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157a0d-6b2b-4e6d-872c-b3752f5a2a1d None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:38.872704 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 753/1506] 10.222.0.57 () {52 vars in 830 bytes} [Tue Aug 2 08:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:19:38.877047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5e5d-f449-4516-8fff-5a6db7f64449 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:19:38.878310 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-fcfe5e5d-f449-4516-8fff-5a6db7f64449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:38.977055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5e5d-f449-4516-8fff-5a6db7f64449 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:19:39.072026 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:19:39.072739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:39.073078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:39.073372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] PATH_INFO: `/v3/users/0df2117ea81b4547b96f9d2c4bd3d089` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:39.085847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df2117ea81b4547b96f9d2c4bd3d089)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:19:39.087532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: WARNING py.warnings [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:19:39.087532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: warnings.warn(msg) Aug 02 08:19:39.087532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: Aug 02 08:19:39.088765 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:19:39.098378 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:39.155759 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df2117ea81b4547b96f9d2c4bd3d089'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:19:39.156321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df2117ea81b4547b96f9d2c4bd3d089'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:19:39.165783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df2117ea81b4547b96f9d2c4bd3d089'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:19:39.188117 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df2117ea81b4547b96f9d2c4bd3d089'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:19:39.188566 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df2117ea81b4547b96f9d2c4bd3d089'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:19:39.208024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 754/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:19:38 2022] DELETE /identity/v3/users/0df2117ea81b4547b96f9d2c4bd3d089 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:19:39.213091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a766d1-77c0-414c-aa12-27d9dd6f58e0 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:39.213379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a766d1-77c0-414c-aa12-27d9dd6f58e0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:39.213655 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a766d1-77c0-414c-aa12-27d9dd6f58e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:39.269863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-77a766d1-77c0-414c-aa12-27d9dd6f58e0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:19:39.271017 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-77a766d1-77c0-414c-aa12-27d9dd6f58e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:39.347047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:39.360778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 754/1508] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:19:39.371082 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:19:39.372488 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:39.475517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2273ab-20e8-4391-9986-dd5ed736c07c admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:19:39.530624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:39.551863 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d636ce-b49d-43ba-934c-f77190e01dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:19:39.552486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d636ce-b49d-43ba-934c-f77190e01dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:39.552768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d636ce-b49d-43ba-934c-f77190e01dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:39.553038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d636ce-b49d-43ba-934c-f77190e01dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:39.554709 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-37d636ce-b49d-43ba-934c-f77190e01dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:39.664489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d636ce-b49d-43ba-934c-f77190e01dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:19:39.666581 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d636ce-b49d-43ba-934c-f77190e01dd7 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:19:39.684726 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 755/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:19:40.031900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a766d1-77c0-414c-aa12-27d9dd6f58e0 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:19:40.033156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-77a766d1-77c0-414c-aa12-27d9dd6f58e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:19:40.044490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a766d1-77c0-414c-aa12-27d9dd6f58e0 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:19:40.150494 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:19:40.151052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:19:40.151333 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:19:40.151607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] PATH_INFO: `/v3/projects/6c8ce8cd6bac4622b8b5294696596128` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:19:40.161326 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8ce8cd6bac4622b8b5294696596128)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:19:40.162382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: WARNING py.warnings [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:19:40.162382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: warnings.warn(msg) Aug 02 08:19:40.162382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: Aug 02 08:19:40.163568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:19:40.220833 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8ce8cd6bac4622b8b5294696596128', 'request_id': 'req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:19:40.233767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8ce8cd6bac4622b8b5294696596128', 'request_id': 'req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:19:40.239746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8ce8cd6bac4622b8b5294696596128', 'request_id': 'req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:19:40.266339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] The token cache is being invalidate because project 6c8ce8cd6bac4622b8b5294696596128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:19:40.266626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:19:40.267053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a45b8eaf-7895-4f97-9e75-3952cdcb7d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:19:40.268487 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 755/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:19:40 2022] DELETE /identity/v3/projects/6c8ce8cd6bac4622b8b5294696596128 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:19:49.682481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=62 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:19:50.264400 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:21:23.687029 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa339f-bd95-4d60-bcdb-9312acbead23 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:23.687643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa339f-bd95-4d60-bcdb-9312acbead23 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:23.687643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa339f-bd95-4d60-bcdb-9312acbead23 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:23.688988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:21:23.693724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846972f-b1b7-46ab-9235-c41bf9a240b4 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:23.694219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846972f-b1b7-46ab-9235-c41bf9a240b4 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:23.694329 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846972f-b1b7-46ab-9235-c41bf9a240b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:23.776537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-f846972f-b1b7-46ab-9235-c41bf9a240b4 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:21:23.777759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f846972f-b1b7-46ab-9235-c41bf9a240b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:23.882690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:21:24.043160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa339f-bd95-4d60-bcdb-9312acbead23 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:21:24.045233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4cfa339f-bd95-4d60-bcdb-9312acbead23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:24.168079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa339f-bd95-4d60-bcdb-9312acbead23 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:21:24.173601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efd6e2-97f3-4f15-bb04-28d7004bf98e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:21:24.174235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd6e2-97f3-4f15-bb04-28d7004bf98e service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:24.174516 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd6e2-97f3-4f15-bb04-28d7004bf98e service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:24.174791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efd6e2-97f3-4f15-bb04-28d7004bf98e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:24.182942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efd6e2-97f3-4f15-bb04-28d7004bf98e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:21:24.184490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efd6e2-97f3-4f15-bb04-28d7004bf98e service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:21:24.193675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 757/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:21:25.030479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ca9f-02c7-4fe7-b8cb-b0ff424219a8 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:25.031092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ca9f-02c7-4fe7-b8cb-b0ff424219a8 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:25.031092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6ca9f-02c7-4fe7-b8cb-b0ff424219a8 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:25.032406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:21:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:21:25.037221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5496ca-4cda-4cf1-a377-90066425a38e None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:25.037662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5496ca-4cda-4cf1-a377-90066425a38e None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:25.037777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5496ca-4cda-4cf1-a377-90066425a38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:25.056713 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6f5496ca-4cda-4cf1-a377-90066425a38e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:21:25.057897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6f5496ca-4cda-4cf1-a377-90066425a38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:25.065630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:21:25.222550 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6ca9f-02c7-4fe7-b8cb-b0ff424219a8 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:21:25.238248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6ca9f-02c7-4fe7-b8cb-b0ff424219a8 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:21:25.244282 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2693a-e788-4234-9303-7314ae21a9af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:21:25.244902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2693a-e788-4234-9303-7314ae21a9af service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:25.245184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2693a-e788-4234-9303-7314ae21a9af service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:25.245460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2693a-e788-4234-9303-7314ae21a9af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:25.254415 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2693a-e788-4234-9303-7314ae21a9af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:21:25.256015 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2693a-e788-4234-9303-7314ae21a9af service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:21:25.265633 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 758/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:21:26.665931 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b97665-fe5a-489c-913e-8e2d1a8c78cb None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:26.666503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b97665-fe5a-489c-913e-8e2d1a8c78cb None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:26.666503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b97665-fe5a-489c-913e-8e2d1a8c78cb None None] PATH_INFO: `/v3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:26.667752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 759/1517] 10.222.0.66 () {54 vars in 925 bytes} [Tue Aug 2 08:21:26 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:21:26.684211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc871-c1d8-4f04-b742-81e864187fb7 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:26.684899 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc871-c1d8-4f04-b742-81e864187fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:26.685131 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc871-c1d8-4f04-b742-81e864187fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:26.744005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-e33dc871-c1d8-4f04-b742-81e864187fb7 None None] MFA Rules not processed for user `3318842c46ec4c6d9b7b1f55c9fab62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:21:26.745197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e33dc871-c1d8-4f04-b742-81e864187fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:26.762380 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:21:26.819795 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 759/1518] 10.222.0.66 () {58 vars in 1015 bytes} [Tue Aug 2 08:21:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:21:30.816336 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dad98-807c-4d8b-9f17-bb4444e9cd35 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:30.816927 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dad98-807c-4d8b-9f17-bb4444e9cd35 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:30.816927 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dad98-807c-4d8b-9f17-bb4444e9cd35 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:30.818265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 760/1519] 10.222.0.57 () {54 vars in 961 bytes} [Tue Aug 2 08:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:21:30.823322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6f271-9366-43e2-adb8-e75b16144b3b None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:30.823794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6f271-9366-43e2-adb8-e75b16144b3b None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:30.823897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6f271-9366-43e2-adb8-e75b16144b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:30.846213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-40f6f271-9366-43e2-adb8-e75b16144b3b None None] MFA Rules not processed for user `3318842c46ec4c6d9b7b1f55c9fab62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:21:30.847482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-40f6f271-9366-43e2-adb8-e75b16144b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:30.856582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 760/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Aug 2 08:21:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:21:30.864179 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dad98-807c-4d8b-9f17-bb4444e9cd35 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:21:30.879590 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dad98-807c-4d8b-9f17-bb4444e9cd35 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:21:30.884955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886db8a5-2b70-4a65-8a17-d6e2b1694b9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3318842c46ec4c6d9b7b1f55c9fab62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:21:30.885606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886db8a5-2b70-4a65-8a17-d6e2b1694b9a service placement] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:30.885882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886db8a5-2b70-4a65-8a17-d6e2b1694b9a service placement] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:30.886395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886db8a5-2b70-4a65-8a17-d6e2b1694b9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:30.895466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886db8a5-2b70-4a65-8a17-d6e2b1694b9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:21:30.897396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886db8a5-2b70-4a65-8a17-d6e2b1694b9a service placement] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:21:30.906954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 761/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:21:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:21:36.490871 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa664d-a0fd-4774-95a2-b4734e20727c None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:36.491423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa664d-a0fd-4774-95a2-b4734e20727c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:36.491423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa664d-a0fd-4774-95a2-b4734e20727c None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:36.492775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:21:36.497723 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e1d2c-2aa7-4707-8bb1-c5ff30617af0 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:36.498219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e1d2c-2aa7-4707-8bb1-c5ff30617af0 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:36.498333 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e1d2c-2aa7-4707-8bb1-c5ff30617af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:36.517760 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-0e1e1d2c-2aa7-4707-8bb1-c5ff30617af0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:21:36.519017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0e1e1d2c-2aa7-4707-8bb1-c5ff30617af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:36.527777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:21:36.686436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa664d-a0fd-4774-95a2-b4734e20727c None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:21:36.703153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa664d-a0fd-4774-95a2-b4734e20727c None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:21:36.708924 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b22f02-812a-46b0-b4e2-adc1c2e2872d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:21:36.709603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b22f02-812a-46b0-b4e2-adc1c2e2872d service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:36.709880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b22f02-812a-46b0-b4e2-adc1c2e2872d service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:36.710213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b22f02-812a-46b0-b4e2-adc1c2e2872d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:36.720057 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b22f02-812a-46b0-b4e2-adc1c2e2872d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:21:36.721637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b22f02-812a-46b0-b4e2-adc1c2e2872d service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:21:36.731997 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 762/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:21:37.564860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb8f11-6e37-472c-bd36-10476c653cab None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:37.565448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb8f11-6e37-472c-bd36-10476c653cab None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:37.565448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb8f11-6e37-472c-bd36-10476c653cab None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:37.566871 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 08:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:21:37.571600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74d63d-421a-4bac-bd5a-87dbba3b2dcb None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:37.572045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74d63d-421a-4bac-bd5a-87dbba3b2dcb None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:37.572156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74d63d-421a-4bac-bd5a-87dbba3b2dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:37.591944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-4c74d63d-421a-4bac-bd5a-87dbba3b2dcb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:21:37.593175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4c74d63d-421a-4bac-bd5a-87dbba3b2dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:37.601047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 08:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:21:37.756709 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb8f11-6e37-472c-bd36-10476c653cab None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:21:37.771125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb8f11-6e37-472c-bd36-10476c653cab None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:21:37.776544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425365d-fac9-4a55-a5c2-73856cbb02d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:21:37.777144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425365d-fac9-4a55-a5c2-73856cbb02d6 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:37.777424 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425365d-fac9-4a55-a5c2-73856cbb02d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:37.777698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425365d-fac9-4a55-a5c2-73856cbb02d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:37.786038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425365d-fac9-4a55-a5c2-73856cbb02d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:21:37.787609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425365d-fac9-4a55-a5c2-73856cbb02d6 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:21:37.797431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 764/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:21:41.614520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a232989-2538-4b03-b455-59a1789a8a50 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:41.615070 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a232989-2538-4b03-b455-59a1789a8a50 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:41.615070 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a232989-2538-4b03-b455-59a1789a8a50 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:41.616644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:21:41.623003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fec68-8b1d-483d-86cd-a0f04ae22b69 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:41.623455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fec68-8b1d-483d-86cd-a0f04ae22b69 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:41.623574 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fec68-8b1d-483d-86cd-a0f04ae22b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:41.644442 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-8b3fec68-8b1d-483d-86cd-a0f04ae22b69 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:21:41.646283 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8b3fec68-8b1d-483d-86cd-a0f04ae22b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:41.654393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:21:41.730204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a232989-2538-4b03-b455-59a1789a8a50 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:21:41.731904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-0a232989-2538-4b03-b455-59a1789a8a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:41.811719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a232989-2538-4b03-b455-59a1789a8a50 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:21:41.815328 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731850a0-91a9-4f23-b685-0d3b03a3864a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:21:41.815943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731850a0-91a9-4f23-b685-0d3b03a3864a service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:41.816241 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731850a0-91a9-4f23-b685-0d3b03a3864a service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:41.816503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731850a0-91a9-4f23-b685-0d3b03a3864a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:41.826667 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731850a0-91a9-4f23-b685-0d3b03a3864a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:21:41.828093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731850a0-91a9-4f23-b685-0d3b03a3864a service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:21:41.837880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 765/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:21:43.854563 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913b8c0-50f3-4104-9a3e-6f316153ce74 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:43.855103 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913b8c0-50f3-4104-9a3e-6f316153ce74 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:43.855103 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913b8c0-50f3-4104-9a3e-6f316153ce74 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:43.856483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:21:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:21:43.861882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ee50a-3d94-4455-9538-a76bb70b003d None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:43.862410 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ee50a-3d94-4455-9538-a76bb70b003d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:43.862496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ee50a-3d94-4455-9538-a76bb70b003d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:43.884085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-9a9ee50a-3d94-4455-9538-a76bb70b003d None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:21:43.885283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9a9ee50a-3d94-4455-9538-a76bb70b003d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:43.893124 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:21:43.930644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913b8c0-50f3-4104-9a3e-6f316153ce74 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:21:43.941355 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913b8c0-50f3-4104-9a3e-6f316153ce74 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:21:43.944817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df40dcb-34e5-42b0-9724-c049aaa6ca41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:21:43.945417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df40dcb-34e5-42b0-9724-c049aaa6ca41 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:43.945694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df40dcb-34e5-42b0-9724-c049aaa6ca41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:43.945965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df40dcb-34e5-42b0-9724-c049aaa6ca41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:43.954866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df40dcb-34e5-42b0-9724-c049aaa6ca41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:21:43.956265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df40dcb-34e5-42b0-9724-c049aaa6ca41 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:21:43.965995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 767/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:21:47.578853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d41c27-aa0e-4f2b-a48f-6b1d8470b828 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:47.579458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d41c27-aa0e-4f2b-a48f-6b1d8470b828 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:47.579458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d41c27-aa0e-4f2b-a48f-6b1d8470b828 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:47.580780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:21:47.587485 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd490d7d-50dd-4087-a266-be2f4f25cdc4 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:47.587932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd490d7d-50dd-4087-a266-be2f4f25cdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:47.588024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd490d7d-50dd-4087-a266-be2f4f25cdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:47.608535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-cd490d7d-50dd-4087-a266-be2f4f25cdc4 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:21:47.609794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-cd490d7d-50dd-4087-a266-be2f4f25cdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:47.617864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:21:47.919274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d41c27-aa0e-4f2b-a48f-6b1d8470b828 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:21:47.921037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f2d41c27-aa0e-4f2b-a48f-6b1d8470b828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:47.986178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:21:47.999767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d41c27-aa0e-4f2b-a48f-6b1d8470b828 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:21:48.003469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30116dd2-2cf8-4fff-84cb-9ac1d06e0a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:21:48.004086 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30116dd2-2cf8-4fff-84cb-9ac1d06e0a02 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:48.004365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30116dd2-2cf8-4fff-84cb-9ac1d06e0a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:48.004642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30116dd2-2cf8-4fff-84cb-9ac1d06e0a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:48.014406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30116dd2-2cf8-4fff-84cb-9ac1d06e0a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:21:48.015816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30116dd2-2cf8-4fff-84cb-9ac1d06e0a02 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:21:48.026631 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 768/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:21:50.031258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783eae4-f723-419d-859a-3f7468600e2f None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:50.031795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783eae4-f723-419d-859a-3f7468600e2f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:50.031795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783eae4-f723-419d-859a-3f7468600e2f None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:50.033183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 08:21:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:21:50.038684 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5adae-77ea-494d-a030-6a3178e19b6a None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:50.039138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5adae-77ea-494d-a030-6a3178e19b6a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:50.039248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5adae-77ea-494d-a030-6a3178e19b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:50.059355 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-35d5adae-77ea-494d-a030-6a3178e19b6a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:21:50.060541 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-35d5adae-77ea-494d-a030-6a3178e19b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:50.068248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 08:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:21:50.369535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783eae4-f723-419d-859a-3f7468600e2f None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:21:50.371538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-f783eae4-f723-419d-859a-3f7468600e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:21:50.379050 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=84 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:21:50.385981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783eae4-f723-419d-859a-3f7468600e2f None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:21:50.389603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b219865-5b22-45d2-9671-65fb2e06b9f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:21:50.390318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219865-5b22-45d2-9671-65fb2e06b9f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:21:50.390600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219865-5b22-45d2-9671-65fb2e06b9f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:21:50.390872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b219865-5b22-45d2-9671-65fb2e06b9f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:21:50.401145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b219865-5b22-45d2-9671-65fb2e06b9f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:21:50.402604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b219865-5b22-45d2-9671-65fb2e06b9f8 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:21:50.411954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 770/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:22:00.054596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=11 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:22:00.407784 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:20.793405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424842-7efe-4742-8e1f-3674a8907b4d None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:20.794073 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424842-7efe-4742-8e1f-3674a8907b4d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:20.794073 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88424842-7efe-4742-8e1f-3674a8907b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:20.827811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-88424842-7efe-4742-8e1f-3674a8907b4d None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:20.829852 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-88424842-7efe-4742-8e1f-3674a8907b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:20.845449 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 770/1540] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:20.854076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a993-2850-48e5-96db-6628286fbca6 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:20.855078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a993-2850-48e5-96db-6628286fbca6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:20.855576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a993-2850-48e5-96db-6628286fbca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:20.880545 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-2c32a993-2850-48e5-96db-6628286fbca6 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:20.881756 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2c32a993-2850-48e5-96db-6628286fbca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:20.899063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 771/1541] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:20.903793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424842-7efe-4742-8e1f-3674a8907b4d None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:20.920801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88424842-7efe-4742-8e1f-3674a8907b4d None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:20.927275 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b832c-ea8a-485e-9690-899db7b7bd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:20.928203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b832c-ea8a-485e-9690-899db7b7bd7a admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:20.928707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b832c-ea8a-485e-9690-899db7b7bd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:20.929203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b832c-ea8a-485e-9690-899db7b7bd7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:20.930926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b832c-ea8a-485e-9690-899db7b7bd7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:20.931508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b832c-ea8a-485e-9690-899db7b7bd7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:20.933553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b832c-ea8a-485e-9690-899db7b7bd7a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:20.950739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 771/1542] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:23:20.958850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32a993-2850-48e5-96db-6628286fbca6 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:20.973231 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32a993-2850-48e5-96db-6628286fbca6 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:20.978916 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6d828-e8b9-47fe-a054-f4d06093fe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:20.979568 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d828-e8b9-47fe-a054-f4d06093fe97 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:20.979847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d828-e8b9-47fe-a054-f4d06093fe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:20.980123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d828-e8b9-47fe-a054-f4d06093fe97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:20.980805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6d828-e8b9-47fe-a054-f4d06093fe97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:20.982784 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6d828-e8b9-47fe-a054-f4d06093fe97 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.048282 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a3de7-b04a-4db0-9e3b-fdb7011870f9 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.048746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 772/1543] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:20 2022] POST /identity/v3/projects => generated 393 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:21.049243 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a3de7-b04a-4db0-9e3b-fdb7011870f9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.049737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a3de7-b04a-4db0-9e3b-fdb7011870f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.053926 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6d828-e8b9-47fe-a054-f4d06093fe97 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.089664 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-231a3de7-b04a-4db0-9e3b-fdb7011870f9 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.091299 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-231a3de7-b04a-4db0-9e3b-fdb7011870f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.162177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6d828-e8b9-47fe-a054-f4d06093fe97 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.169372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7449ef-df41-4a91-b0b7-c4f0574ee4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.170175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7449ef-df41-4a91-b0b7-c4f0574ee4ce admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.170470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7449ef-df41-4a91-b0b7-c4f0574ee4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.170747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7449ef-df41-4a91-b0b7-c4f0574ee4ce admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.171422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7449ef-df41-4a91-b0b7-c4f0574ee4ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.177980 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: WARNING py.warnings [None req-7d7449ef-df41-4a91-b0b7-c4f0574ee4ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:23:21.177980 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: warnings.warn(msg) Aug 02 08:23:21.177980 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: Aug 02 08:23:21.179325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7449ef-df41-4a91-b0b7-c4f0574ee4ce admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.201341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 772/1544] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:23:21.202741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a1c7-1baf-497f-a7a2-089e074d7b77 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.203028 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a1c7-1baf-497f-a7a2-089e074d7b77 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.203375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935a1c7-1baf-497f-a7a2-089e074d7b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.215051 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 773/1545] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:23:21.221580 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83a42-2816-4d53-b9f2-6ca4b04b5552 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.221897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83a42-2816-4d53-b9f2-6ca4b04b5552 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.222209 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83a42-2816-4d53-b9f2-6ca4b04b5552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.254707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-2935a1c7-1baf-497f-a7a2-089e074d7b77 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.255920 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-2935a1c7-1baf-497f-a7a2-089e074d7b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.263732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-f0f83a42-2816-4d53-b9f2-6ca4b04b5552 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.264976 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-f0f83a42-2816-4d53-b9f2-6ca4b04b5552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.274206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 773/1546] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.275526 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b5b91-223e-49f4-904b-7f4bc0aa0ac4 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.275815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b5b91-223e-49f4-904b-7f4bc0aa0ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.276094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b5b91-223e-49f4-904b-7f4bc0aa0ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.284781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 774/1547] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.285658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f83a42-2816-4d53-b9f2-6ca4b04b5552 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.305517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f83a42-2816-4d53-b9f2-6ca4b04b5552 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.311765 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-295b5b91-223e-49f4-904b-7f4bc0aa0ac4 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.313383 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-295b5b91-223e-49f4-904b-7f4bc0aa0ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.319803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32a385-0d1b-4c56-96bd-7d5383474699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.321724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32a385-0d1b-4c56-96bd-7d5383474699 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.322253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32a385-0d1b-4c56-96bd-7d5383474699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.322734 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32a385-0d1b-4c56-96bd-7d5383474699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.322933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 774/1548] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.323842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32a385-0d1b-4c56-96bd-7d5383474699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.324335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913291-084a-4034-a278-e9a3def8123c None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.324627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913291-084a-4034-a278-e9a3def8123c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.324904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe913291-084a-4034-a278-e9a3def8123c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.326394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32a385-0d1b-4c56-96bd-7d5383474699 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.349729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 775/1549] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:21.355076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bd8a-e049-4a19-8ec3-23e24177ffaa None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.355076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bd8a-e049-4a19-8ec3-23e24177ffaa None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.355076 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bd8a-e049-4a19-8ec3-23e24177ffaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.361257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-fe913291-084a-4034-a278-e9a3def8123c None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.366029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fe913291-084a-4034-a278-e9a3def8123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.379136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 775/1550] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.380404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c7a7b-96e1-4379-a5f6-c0dbac8adc06 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.380690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c7a7b-96e1-4379-a5f6-c0dbac8adc06 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.381556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c7a7b-96e1-4379-a5f6-c0dbac8adc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.388821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-e572bd8a-e049-4a19-8ec3-23e24177ffaa None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.390077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e572bd8a-e049-4a19-8ec3-23e24177ffaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.399716 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 776/1551] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.400519 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572bd8a-e049-4a19-8ec3-23e24177ffaa None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.402699 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-218c7a7b-96e1-4379-a5f6-c0dbac8adc06 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.404023 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-218c7a7b-96e1-4379-a5f6-c0dbac8adc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.410706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572bd8a-e049-4a19-8ec3-23e24177ffaa None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.413030 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 776/1552] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.420841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c7a7b-96e1-4379-a5f6-c0dbac8adc06 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.423917 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d42635-cbe2-401f-9c5c-31582164321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.424075 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c7a7b-96e1-4379-a5f6-c0dbac8adc06 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.424619 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42635-cbe2-401f-9c5c-31582164321b admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.424841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42635-cbe2-401f-9c5c-31582164321b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.425122 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d42635-cbe2-401f-9c5c-31582164321b admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.425825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d42635-cbe2-401f-9c5c-31582164321b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:21.426168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d42635-cbe2-401f-9c5c-31582164321b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.427192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: WARNING py.warnings [None req-06d42635-cbe2-401f-9c5c-31582164321b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:23:21.427192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: warnings.warn(msg) Aug 02 08:23:21.427192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: Aug 02 08:23:21.428073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d42635-cbe2-401f-9c5c-31582164321b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.429052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f02a59-95c1-40ea-9e71-50845f44f110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.429886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f02a59-95c1-40ea-9e71-50845f44f110 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.430182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f02a59-95c1-40ea-9e71-50845f44f110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.430467 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f02a59-95c1-40ea-9e71-50845f44f110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.431680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f02a59-95c1-40ea-9e71-50845f44f110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.433329 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f02a59-95c1-40ea-9e71-50845f44f110 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.445412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 777/1553] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:23:21.445412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358faed-9fc9-40c3-ac86-d622024a4f74 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.445412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358faed-9fc9-40c3-ac86-d622024a4f74 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.445412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358faed-9fc9-40c3-ac86-d622024a4f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.446078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 777/1554] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:21.446398 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f02a59-95c1-40ea-9e71-50845f44f110 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.457805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f02a59-95c1-40ea-9e71-50845f44f110 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.463588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79246176-75c3-4f14-a967-9fec756284a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.464208 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79246176-75c3-4f14-a967-9fec756284a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.464490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79246176-75c3-4f14-a967-9fec756284a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.464770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79246176-75c3-4f14-a967-9fec756284a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.465462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79246176-75c3-4f14-a967-9fec756284a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:21.465769 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79246176-75c3-4f14-a967-9fec756284a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.467523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79246176-75c3-4f14-a967-9fec756284a5 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.468953 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-2358faed-9fc9-40c3-ac86-d622024a4f74 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.470452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2358faed-9fc9-40c3-ac86-d622024a4f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.479731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 778/1555] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.480560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 778/1556] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:23:21.481381 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79246176-75c3-4f14-a967-9fec756284a5 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.482044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebcb84-4d94-4e55-9400-bbdb4299d3cf None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.482548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebcb84-4d94-4e55-9400-bbdb4299d3cf None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.482825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebcb84-4d94-4e55-9400-bbdb4299d3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.497638 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79246176-75c3-4f14-a967-9fec756284a5 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.503328 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c891d82-6401-4fff-a3f5-3c454b2ebb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.504287 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891d82-6401-4fff-a3f5-3c454b2ebb74 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.504766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891d82-6401-4fff-a3f5-3c454b2ebb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.505042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891d82-6401-4fff-a3f5-3c454b2ebb74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.505739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c891d82-6401-4fff-a3f5-3c454b2ebb74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:21.506081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c891d82-6401-4fff-a3f5-3c454b2ebb74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.508352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c891d82-6401-4fff-a3f5-3c454b2ebb74 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.511417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-fdebcb84-4d94-4e55-9400-bbdb4299d3cf None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.512625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-fdebcb84-4d94-4e55-9400-bbdb4299d3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.530050 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 779/1557] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.530260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 779/1558] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:23:21.530260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c891d82-6401-4fff-a3f5-3c454b2ebb74 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.530464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb83ee-8e3c-493d-ae31-e03fceaf4584 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.530464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb83ee-8e3c-493d-ae31-e03fceaf4584 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.530464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb83ee-8e3c-493d-ae31-e03fceaf4584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.543494 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c891d82-6401-4fff-a3f5-3c454b2ebb74 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.548511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efda48-d179-4f34-9701-141499a58d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.548773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-57fb83ee-8e3c-493d-ae31-e03fceaf4584 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.549211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efda48-d179-4f34-9701-141499a58d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.549497 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efda48-d179-4f34-9701-141499a58d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.549774 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efda48-d179-4f34-9701-141499a58d30 admin admin] PATH_INFO: `/v3/projects/83a5eb024f674ab3957575f1bd23e616/users/dc97bab8d9c943ee968db907513cc0f8/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.552014 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-57fb83ee-8e3c-493d-ae31-e03fceaf4584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.560358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 780/1559] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.564931 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb83ee-8e3c-493d-ae31-e03fceaf4584 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.572998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efda48-d179-4f34-9701-141499a58d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a5eb024f674ab3957575f1bd23e616, user_id=dc97bab8d9c943ee968db907513cc0f8, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.574382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb83ee-8e3c-493d-ae31-e03fceaf4584 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.574548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: WARNING py.warnings [None req-38efda48-d179-4f34-9701-141499a58d30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:23:21.574548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: warnings.warn(msg) Aug 02 08:23:21.574548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: Aug 02 08:23:21.576376 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efda48-d179-4f34-9701-141499a58d30 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.578943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de65536-0958-407d-adf1-29a630f25d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.579727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65536-0958-407d-adf1-29a630f25d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.580010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65536-0958-407d-adf1-29a630f25d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.580285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65536-0958-407d-adf1-29a630f25d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.580979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de65536-0958-407d-adf1-29a630f25d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.583720 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de65536-0958-407d-adf1-29a630f25d7f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.590319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 780/1560] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:21 2022] PUT /identity/v3/projects/83a5eb024f674ab3957575f1bd23e616/users/dc97bab8d9c943ee968db907513cc0f8/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:21.591719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd1010-7d11-4ab7-8733-b6301da4c2cb None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.592147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd1010-7d11-4ab7-8733-b6301da4c2cb None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.592428 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd1010-7d11-4ab7-8733-b6301da4c2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.616264 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 781/1561] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:21.616484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-babd1010-7d11-4ab7-8733-b6301da4c2cb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.616595 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de65536-0958-407d-adf1-29a630f25d7f admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.616702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-babd1010-7d11-4ab7-8733-b6301da4c2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.649629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:21.663597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:21.677466 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 781/1562] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.681193 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd1010-7d11-4ab7-8733-b6301da4c2cb None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.681304 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de65536-0958-407d-adf1-29a630f25d7f admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.684363 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ff3b5-1cfd-462c-8b19-55006a0ca6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.684979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ff3b5-1cfd-462c-8b19-55006a0ca6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.685277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ff3b5-1cfd-462c-8b19-55006a0ca6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.685557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ff3b5-1cfd-462c-8b19-55006a0ca6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.686255 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ff3b5-1cfd-462c-8b19-55006a0ca6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.687786 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd1010-7d11-4ab7-8733-b6301da4c2cb None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.688149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ff3b5-1cfd-462c-8b19-55006a0ca6e7 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.692314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82524081-6f1c-4b72-bef9-c3b383589bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.692911 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82524081-6f1c-4b72-bef9-c3b383589bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.693189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82524081-6f1c-4b72-bef9-c3b383589bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.693468 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82524081-6f1c-4b72-bef9-c3b383589bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.694150 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82524081-6f1c-4b72-bef9-c3b383589bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.695692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: WARNING py.warnings [None req-82524081-6f1c-4b72-bef9-c3b383589bc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:23:21.695692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: warnings.warn(msg) Aug 02 08:23:21.695692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: Aug 02 08:23:21.696862 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82524081-6f1c-4b72-bef9-c3b383589bc6 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.718019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 782/1563] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:21.722599 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96bf8e-4ba4-4ee1-86fd-8c124f6208df None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.722884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96bf8e-4ba4-4ee1-86fd-8c124f6208df None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.723160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96bf8e-4ba4-4ee1-86fd-8c124f6208df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.725215 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 782/1564] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:21.726272 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82524081-6f1c-4b72-bef9-c3b383589bc6 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.742286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-4b96bf8e-4ba4-4ee1-86fd-8c124f6208df None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.743854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4b96bf8e-4ba4-4ee1-86fd-8c124f6208df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.791075 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82524081-6f1c-4b72-bef9-c3b383589bc6 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.796470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5150e-e8b9-4dce-96ca-56295814a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.797089 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5150e-e8b9-4dce-96ca-56295814a461 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.797372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5150e-e8b9-4dce-96ca-56295814a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.797658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5150e-e8b9-4dce-96ca-56295814a461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.798533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5150e-e8b9-4dce-96ca-56295814a461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:21.798841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5150e-e8b9-4dce-96ca-56295814a461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.800443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5150e-e8b9-4dce-96ca-56295814a461 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.805057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 783/1565] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.806456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ac8d-e6cf-44b0-93a5-d3767a3c5ee1 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.806719 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ac8d-e6cf-44b0-93a5-d3767a3c5ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.806994 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516ac8d-e6cf-44b0-93a5-d3767a3c5ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.812510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 783/1566] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:23:21.813812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e8d08-56b0-413c-8d41-20f4ed8e7eec None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.814141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e8d08-56b0-413c-8d41-20f4ed8e7eec None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.814457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e8d08-56b0-413c-8d41-20f4ed8e7eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.832168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-e516ac8d-e6cf-44b0-93a5-d3767a3c5ee1 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.833384 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e516ac8d-e6cf-44b0-93a5-d3767a3c5ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.833913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-4b2e8d08-56b0-413c-8d41-20f4ed8e7eec None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.835121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4b2e8d08-56b0-413c-8d41-20f4ed8e7eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.849417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 784/1567] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.849417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ac8d-e6cf-44b0-93a5-d3767a3c5ee1 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.850269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 784/1568] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.850269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e8d08-56b0-413c-8d41-20f4ed8e7eec None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.852418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516ac8d-e6cf-44b0-93a5-d3767a3c5ee1 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.855748 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e8d08-56b0-413c-8d41-20f4ed8e7eec None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.857063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f8729-f4c6-4cbe-88c8-5b75de5ac11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.857702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f8729-f4c6-4cbe-88c8-5b75de5ac11c admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.857980 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f8729-f4c6-4cbe-88c8-5b75de5ac11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.858291 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f8729-f4c6-4cbe-88c8-5b75de5ac11c admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.858957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f8729-f4c6-4cbe-88c8-5b75de5ac11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.860359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195169b-964b-4143-84aa-fb857215aeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.860862 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f8729-f4c6-4cbe-88c8-5b75de5ac11c admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.861015 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195169b-964b-4143-84aa-fb857215aeaa admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.861357 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195169b-964b-4143-84aa-fb857215aeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.861638 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195169b-964b-4143-84aa-fb857215aeaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.862377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195169b-964b-4143-84aa-fb857215aeaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:21.862681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195169b-964b-4143-84aa-fb857215aeaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.864281 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195169b-964b-4143-84aa-fb857215aeaa admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.876515 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 785/1569] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:23:21.877316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195169b-964b-4143-84aa-fb857215aeaa admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.884850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 785/1570] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/users => generated 282 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:21.885848 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f8729-f4c6-4cbe-88c8-5b75de5ac11c admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.888302 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195169b-964b-4143-84aa-fb857215aeaa admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.893148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b933c-2c9c-4320-b63e-cec9f596024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.893764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b933c-2c9c-4320-b63e-cec9f596024c admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.894074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b933c-2c9c-4320-b63e-cec9f596024c admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.894383 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b933c-2c9c-4320-b63e-cec9f596024c admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.895105 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b933c-2c9c-4320-b63e-cec9f596024c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.895727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f8729-f4c6-4cbe-88c8-5b75de5ac11c admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.897130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b933c-2c9c-4320-b63e-cec9f596024c admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.900924 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5e0a8-1d4a-4d26-9d53-f319fa90a4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.901527 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5e0a8-1d4a-4d26-9d53-f319fa90a4de admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.901812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5e0a8-1d4a-4d26-9d53-f319fa90a4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.902217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5e0a8-1d4a-4d26-9d53-f319fa90a4de admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.902883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5e0a8-1d4a-4d26-9d53-f319fa90a4de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.904758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5e0a8-1d4a-4d26-9d53-f319fa90a4de admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.919010 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 786/1571] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:21.919910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b933c-2c9c-4320-b63e-cec9f596024c admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.925604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 786/1572] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:21.926295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5e0a8-1d4a-4d26-9d53-f319fa90a4de admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.931645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b933c-2c9c-4320-b63e-cec9f596024c admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.936324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe9def-afff-4b3a-8bbf-a87a1806b914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.936944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9def-afff-4b3a-8bbf-a87a1806b914 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.937225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9def-afff-4b3a-8bbf-a87a1806b914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.937498 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9def-afff-4b3a-8bbf-a87a1806b914 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.937644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5e0a8-1d4a-4d26-9d53-f319fa90a4de admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:21.938208 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe9def-afff-4b3a-8bbf-a87a1806b914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:21.938513 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe9def-afff-4b3a-8bbf-a87a1806b914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.940095 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe9def-afff-4b3a-8bbf-a87a1806b914 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.942401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d234d-f2a3-4541-ba0b-2e3334e352b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:21.942997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d234d-f2a3-4541-ba0b-2e3334e352b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.943278 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d234d-f2a3-4541-ba0b-2e3334e352b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.943554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d234d-f2a3-4541-ba0b-2e3334e352b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.944211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d234d-f2a3-4541-ba0b-2e3334e352b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:21.946641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d234d-f2a3-4541-ba0b-2e3334e352b6 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:21.953416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 787/1573] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:23:21.954769 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a5999-b40b-4fb0-8e96-7ac05884c68d None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:21.955053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a5999-b40b-4fb0-8e96-7ac05884c68d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:21.955324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a5999-b40b-4fb0-8e96-7ac05884c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:21.975003 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-b61a5999-b40b-4fb0-8e96-7ac05884c68d None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:21.976220 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b61a5999-b40b-4fb0-8e96-7ac05884c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:21.982502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 787/1574] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:21.983708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d234d-f2a3-4541-ba0b-2e3334e352b6 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.984140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 788/1575] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:21.984877 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a5999-b40b-4fb0-8e96-7ac05884c68d None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:21.994584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a5999-b40b-4fb0-8e96-7ac05884c68d None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.041402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d234d-f2a3-4541-ba0b-2e3334e352b6 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.045164 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad16c5-073d-4cf4-ae00-219f3da839ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.046075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad16c5-073d-4cf4-ae00-219f3da839ef service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.046355 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad16c5-073d-4cf4-ae00-219f3da839ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.046626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad16c5-073d-4cf4-ae00-219f3da839ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.052958 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a923eb9-d45e-45d1-8016-373f47987db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.053583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a923eb9-d45e-45d1-8016-373f47987db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.053972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a923eb9-d45e-45d1-8016-373f47987db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.054875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a923eb9-d45e-45d1-8016-373f47987db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.055557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:22.055670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a923eb9-d45e-45d1-8016-373f47987db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.057499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a923eb9-d45e-45d1-8016-373f47987db6 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.073297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:22.089721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 789/1576] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:21 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:22.089721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a923eb9-d45e-45d1-8016-373f47987db6 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.109683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad16c5-073d-4cf4-ae00-219f3da839ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.111247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad16c5-073d-4cf4-ae00-219f3da839ef service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.121629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 788/1577] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:22.122579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad16c5-073d-4cf4-ae00-219f3da839ef service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.131801 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad16c5-073d-4cf4-ae00-219f3da839ef service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.156408 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a923eb9-d45e-45d1-8016-373f47987db6 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.161719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640302d-4e6c-494d-aafd-da87368febd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.162395 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640302d-4e6c-494d-aafd-da87368febd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.163094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640302d-4e6c-494d-aafd-da87368febd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.163386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640302d-4e6c-494d-aafd-da87368febd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.164815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640302d-4e6c-494d-aafd-da87368febd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.166399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640302d-4e6c-494d-aafd-da87368febd2 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.176753 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 790/1578] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:22.177748 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640302d-4e6c-494d-aafd-da87368febd2 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.187565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640302d-4e6c-494d-aafd-da87368febd2 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.193984 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef01555-718f-4086-9ea0-f5174202df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.194633 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef01555-718f-4086-9ea0-f5174202df2a admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.194922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef01555-718f-4086-9ea0-f5174202df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.195229 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef01555-718f-4086-9ea0-f5174202df2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.196236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef01555-718f-4086-9ea0-f5174202df2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.197939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef01555-718f-4086-9ea0-f5174202df2a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.199391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fb31d-5787-4b2a-bf26-743002a8c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.200023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb31d-5787-4b2a-bf26-743002a8c07b admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.200295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb31d-5787-4b2a-bf26-743002a8c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.200572 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fb31d-5787-4b2a-bf26-743002a8c07b admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.202227 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fb31d-5787-4b2a-bf26-743002a8c07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.204235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fb31d-5787-4b2a-bf26-743002a8c07b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.214715 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 791/1579] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:22.214715 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef01555-718f-4086-9ea0-f5174202df2a admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.221413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 789/1580] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:22.221413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fb31d-5787-4b2a-bf26-743002a8c07b admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.230540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef01555-718f-4086-9ea0-f5174202df2a admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.231102 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fb31d-5787-4b2a-bf26-743002a8c07b admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.236204 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5ac3e-2eca-4314-a7d7-b691ac6e1d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.236690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d9ad6-68eb-432f-b00c-526436f6770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.236860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5ac3e-2eca-4314-a7d7-b691ac6e1d57 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.237083 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5ac3e-2eca-4314-a7d7-b691ac6e1d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.237355 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5ac3e-2eca-4314-a7d7-b691ac6e1d57 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.237520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d9ad6-68eb-432f-b00c-526436f6770a admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.237801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d9ad6-68eb-432f-b00c-526436f6770a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.238124 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d9ad6-68eb-432f-b00c-526436f6770a admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.238227 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5ac3e-2eca-4314-a7d7-b691ac6e1d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.238817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d9ad6-68eb-432f-b00c-526436f6770a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.240075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5ac3e-2eca-4314-a7d7-b691ac6e1d57 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.240829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d9ad6-68eb-432f-b00c-526436f6770a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.269334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 790/1581] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:22 2022] POST /identity/v3/users => generated 295 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:22.270817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5ac3e-2eca-4314-a7d7-b691ac6e1d57 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.277560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 792/1582] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:22 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:22.277560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d9ad6-68eb-432f-b00c-526436f6770a admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.283534 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5ac3e-2eca-4314-a7d7-b691ac6e1d57 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.360851 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fe83a-f561-4abb-a0f7-114c4e15f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.361790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fe83a-f561-4abb-a0f7-114c4e15f96a admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.362358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fe83a-f561-4abb-a0f7-114c4e15f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.362652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fe83a-f561-4abb-a0f7-114c4e15f96a admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.363433 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fe83a-f561-4abb-a0f7-114c4e15f96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:22.363747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fe83a-f561-4abb-a0f7-114c4e15f96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.365420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fe83a-f561-4abb-a0f7-114c4e15f96a admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.372550 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d9ad6-68eb-432f-b00c-526436f6770a admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.377688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c7539-e094-4a28-a684-0fe7ab3086fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.378366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7539-e094-4a28-a684-0fe7ab3086fd admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.378882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7539-e094-4a28-a684-0fe7ab3086fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.379160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7539-e094-4a28-a684-0fe7ab3086fd admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.379840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c7539-e094-4a28-a684-0fe7ab3086fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.380431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 791/1583] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:23:22.381277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fe83a-f561-4abb-a0f7-114c4e15f96a admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.390888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c7539-e094-4a28-a684-0fe7ab3086fd admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.392238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fe83a-f561-4abb-a0f7-114c4e15f96a admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.397770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f7c2c-024a-42f4-aac6-bda5d8eb1e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.399199 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f7c2c-024a-42f4-aac6-bda5d8eb1e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.399551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f7c2c-024a-42f4-aac6-bda5d8eb1e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.399898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f7c2c-024a-42f4-aac6-bda5d8eb1e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.400669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f7c2c-024a-42f4-aac6-bda5d8eb1e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.402474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f7c2c-024a-42f4-aac6-bda5d8eb1e17 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.420387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 792/1584] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:22.420387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f7c2c-024a-42f4-aac6-bda5d8eb1e17 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.420797 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 793/1585] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:22 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:22.420797 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c7539-e094-4a28-a684-0fe7ab3086fd admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.433352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f7c2c-024a-42f4-aac6-bda5d8eb1e17 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.433860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c7539-e094-4a28-a684-0fe7ab3086fd admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.438081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639eb0c0-a72d-4b05-bc9e-232ab95f4fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.438741 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eb0c0-a72d-4b05-bc9e-232ab95f4fab admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.438955 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934fba3-a27d-4a94-bae7-f9da313898a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.439091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eb0c0-a72d-4b05-bc9e-232ab95f4fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.439296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eb0c0-a72d-4b05-bc9e-232ab95f4fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.439551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934fba3-a27d-4a94-bae7-f9da313898a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.439840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934fba3-a27d-4a94-bae7-f9da313898a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.440113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934fba3-a27d-4a94-bae7-f9da313898a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.440389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639eb0c0-a72d-4b05-bc9e-232ab95f4fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.441026 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934fba3-a27d-4a94-bae7-f9da313898a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.442205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639eb0c0-a72d-4b05-bc9e-232ab95f4fab admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.442653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934fba3-a27d-4a94-bae7-f9da313898a4 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.443880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:22.455782 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 794/1586] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:22.456409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934fba3-a27d-4a94-bae7-f9da313898a4 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.462181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 793/1587] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:22.464288 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639eb0c0-a72d-4b05-bc9e-232ab95f4fab admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.467055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934fba3-a27d-4a94-bae7-f9da313898a4 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.472179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9aa91b-2ff7-434f-95de-01f380cc20c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.472689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa91b-2ff7-434f-95de-01f380cc20c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.472877 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa91b-2ff7-434f-95de-01f380cc20c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.473085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa91b-2ff7-434f-95de-01f380cc20c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.473767 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9aa91b-2ff7-434f-95de-01f380cc20c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.475820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9aa91b-2ff7-434f-95de-01f380cc20c3 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.475953 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639eb0c0-a72d-4b05-bc9e-232ab95f4fab admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.481655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eee316-8134-439b-a182-0c2824d35e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.482349 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eee316-8134-439b-a182-0c2824d35e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.482704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eee316-8134-439b-a182-0c2824d35e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.482988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eee316-8134-439b-a182-0c2824d35e38 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.483659 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eee316-8134-439b-a182-0c2824d35e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.485799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eee316-8134-439b-a182-0c2824d35e38 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.497140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 795/1588] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:22.497140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9aa91b-2ff7-434f-95de-01f380cc20c3 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.512274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 794/1589] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:22 2022] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:22.513653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eee316-8134-439b-a182-0c2824d35e38 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.515520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9aa91b-2ff7-434f-95de-01f380cc20c3 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.520640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2319e-0c2e-4ecb-a4ec-2a7e5aa76590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.521270 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2319e-0c2e-4ecb-a4ec-2a7e5aa76590 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.521699 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2319e-0c2e-4ecb-a4ec-2a7e5aa76590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.521988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2319e-0c2e-4ecb-a4ec-2a7e5aa76590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.522689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2319e-0c2e-4ecb-a4ec-2a7e5aa76590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.525223 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2319e-0c2e-4ecb-a4ec-2a7e5aa76590 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.527338 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eee316-8134-439b-a182-0c2824d35e38 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.532110 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22adb6-a7e8-4790-bdea-4db0f32b127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.532742 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22adb6-a7e8-4790-bdea-4db0f32b127e admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.533065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22adb6-a7e8-4790-bdea-4db0f32b127e admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.533345 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22adb6-a7e8-4790-bdea-4db0f32b127e admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.534147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22adb6-a7e8-4790-bdea-4db0f32b127e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.535745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22adb6-a7e8-4790-bdea-4db0f32b127e admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.548631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 795/1590] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:22.552311 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22adb6-a7e8-4790-bdea-4db0f32b127e admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.565858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22adb6-a7e8-4790-bdea-4db0f32b127e admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.567607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 796/1591] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:22 2022] POST /identity/v3/projects => generated 405 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:22.568746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2319e-0c2e-4ecb-a4ec-2a7e5aa76590 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.575170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:22.639253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483e3ef-af01-4641-bb24-aa543819cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.640159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483e3ef-af01-4641-bb24-aa543819cfdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.640159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483e3ef-af01-4641-bb24-aa543819cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.640369 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483e3ef-af01-4641-bb24-aa543819cfdf admin admin] PATH_INFO: `/v3/projects/7672f3e82d4d4ce294c7a5176ff6e0f5/users/d7f55854f32d47988d0ca6d4641c5649/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.657954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2319e-0c2e-4ecb-a4ec-2a7e5aa76590 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.658673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483e3ef-af01-4641-bb24-aa543819cfdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7672f3e82d4d4ce294c7a5176ff6e0f5, user_id=d7f55854f32d47988d0ca6d4641c5649, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.661430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483e3ef-af01-4641-bb24-aa543819cfdf admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.663194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31fc8c-b7ec-44b5-a50e-d297dd2a7e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.663967 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31fc8c-b7ec-44b5-a50e-d297dd2a7e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.664321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31fc8c-b7ec-44b5-a50e-d297dd2a7e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.664678 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31fc8c-b7ec-44b5-a50e-d297dd2a7e08 admin admin] PATH_INFO: `/v3/projects/01e3882e516e4d2a99efe55af3942458/users/e9bd6a66cbc94a5686d96957a9724ff6/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.677277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 796/1592] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:22 2022] PUT /identity/v3/projects/7672f3e82d4d4ce294c7a5176ff6e0f5/users/d7f55854f32d47988d0ca6d4641c5649/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:22.687807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31fc8c-b7ec-44b5-a50e-d297dd2a7e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e3882e516e4d2a99efe55af3942458, user_id=e9bd6a66cbc94a5686d96957a9724ff6, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.687933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483e3ef-af01-4641-bb24-aa543819cfdf admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.688035 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31fc8c-b7ec-44b5-a50e-d297dd2a7e08 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.704026 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 797/1593] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:22 2022] PUT /identity/v3/projects/01e3882e516e4d2a99efe55af3942458/users/e9bd6a66cbc94a5686d96957a9724ff6/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:22.704026 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31fc8c-b7ec-44b5-a50e-d297dd2a7e08 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.755912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483e3ef-af01-4641-bb24-aa543819cfdf admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.776432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31fc8c-b7ec-44b5-a50e-d297dd2a7e08 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.781875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae9861-a3a5-4406-bc86-33d9e819dc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.783491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae9861-a3a5-4406-bc86-33d9e819dc55 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.783491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae9861-a3a5-4406-bc86-33d9e819dc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.783491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae9861-a3a5-4406-bc86-33d9e819dc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.784493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae9861-a3a5-4406-bc86-33d9e819dc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.786391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae9861-a3a5-4406-bc86-33d9e819dc55 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.798655 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 798/1594] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:22.799810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae9861-a3a5-4406-bc86-33d9e819dc55 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.811749 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae9861-a3a5-4406-bc86-33d9e819dc55 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.818075 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35c089-3fb4-494c-bda9-40d1ef0a1a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.818893 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35c089-3fb4-494c-bda9-40d1ef0a1a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.819269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35c089-3fb4-494c-bda9-40d1ef0a1a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.819654 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35c089-3fb4-494c-bda9-40d1ef0a1a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.821071 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35c089-3fb4-494c-bda9-40d1ef0a1a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.821547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:22.822925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35c089-3fb4-494c-bda9-40d1ef0a1a84 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.830315 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575abb1f-1b31-40a6-a3d2-71f7df396e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.836344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 799/1595] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:22.836344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35c089-3fb4-494c-bda9-40d1ef0a1a84 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.837835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abb1f-1b31-40a6-a3d2-71f7df396e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.838557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abb1f-1b31-40a6-a3d2-71f7df396e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.838849 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575abb1f-1b31-40a6-a3d2-71f7df396e65 admin admin] PATH_INFO: `/v3/projects/811410ad686747979d35dff7db1ca1eb/users/d3add387f18e4719b5cc91aaf09921ae/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.845948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35c089-3fb4-494c-bda9-40d1ef0a1a84 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.851235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970199a-ab2a-4b5d-952f-c24793ed5b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.851855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970199a-ab2a-4b5d-952f-c24793ed5b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.852204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970199a-ab2a-4b5d-952f-c24793ed5b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.852395 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970199a-ab2a-4b5d-952f-c24793ed5b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.853090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970199a-ab2a-4b5d-952f-c24793ed5b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.855015 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970199a-ab2a-4b5d-952f-c24793ed5b54 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.857111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575abb1f-1b31-40a6-a3d2-71f7df396e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811410ad686747979d35dff7db1ca1eb, user_id=d3add387f18e4719b5cc91aaf09921ae, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.859966 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575abb1f-1b31-40a6-a3d2-71f7df396e65 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.873879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 800/1596] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:22.873879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970199a-ab2a-4b5d-952f-c24793ed5b54 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:22.888529 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 797/1597] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:22 2022] PUT /identity/v3/projects/811410ad686747979d35dff7db1ca1eb/users/d3add387f18e4719b5cc91aaf09921ae/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:22.888529 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acc796-5633-4213-b022-a911053b4fd8 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.888529 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acc796-5633-4213-b022-a911053b4fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.888529 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acc796-5633-4213-b022-a911053b4fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.889000 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970199a-ab2a-4b5d-952f-c24793ed5b54 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:22.908607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-88acc796-5633-4213-b022-a911053b4fd8 None None] MFA Rules not processed for user `d7f55854f32d47988d0ca6d4641c5649`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:22.909827 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-88acc796-5633-4213-b022-a911053b4fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:22.954541 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09426f-6ef5-42a9-83c8-04d66b3bea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:22.955489 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09426f-6ef5-42a9-83c8-04d66b3bea91 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:22.955778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09426f-6ef5-42a9-83c8-04d66b3bea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:22.956060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09426f-6ef5-42a9-83c8-04d66b3bea91 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:22.957544 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09426f-6ef5-42a9-83c8-04d66b3bea91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:22.960285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09426f-6ef5-42a9-83c8-04d66b3bea91 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:22.974283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:23.000198 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 798/1598] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:23.001417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 801/1599] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:22 2022] POST /identity/v3/users => generated 303 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:23.002197 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16fd22-83c7-4210-9f40-9ea526a99ff7 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.002551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09426f-6ef5-42a9-83c8-04d66b3bea91 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:23.002842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16fd22-83c7-4210-9f40-9ea526a99ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.003270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16fd22-83c7-4210-9f40-9ea526a99ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.015325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09426f-6ef5-42a9-83c8-04d66b3bea91 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:23.020915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748efd-90eb-4919-9f61-9973424f814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:23.021714 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748efd-90eb-4919-9f61-9973424f814f admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.022174 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748efd-90eb-4919-9f61-9973424f814f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.022543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748efd-90eb-4919-9f61-9973424f814f admin admin] PATH_INFO: `/v3/projects/c85c2bc692154546a07ef93908afd57f/users/4a3a53f881ed4686a8dce1fb2b6df04d/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.028736 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-8a16fd22-83c7-4210-9f40-9ea526a99ff7 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:23.030358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8a16fd22-83c7-4210-9f40-9ea526a99ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:23.041799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05748efd-90eb-4919-9f61-9973424f814f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85c2bc692154546a07ef93908afd57f, user_id=4a3a53f881ed4686a8dce1fb2b6df04d, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:23.042588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 799/1600] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:23.045434 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05748efd-90eb-4919-9f61-9973424f814f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:23.053159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16fd22-83c7-4210-9f40-9ea526a99ff7 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:23.066585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 802/1601] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:23 2022] PUT /identity/v3/projects/c85c2bc692154546a07ef93908afd57f/users/4a3a53f881ed4686a8dce1fb2b6df04d/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:23.068895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748efd-90eb-4919-9f61-9973424f814f admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:23.075511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16fd22-83c7-4210-9f40-9ea526a99ff7 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:23.153430 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748efd-90eb-4919-9f61-9973424f814f admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:23.154806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1d5e4-c14f-44d0-a006-bbc3e3c0c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:23.155636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d5e4-c14f-44d0-a006-bbc3e3c0c0df admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.155872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d5e4-c14f-44d0-a006-bbc3e3c0c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.156247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d5e4-c14f-44d0-a006-bbc3e3c0c0df admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.157053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1d5e4-c14f-44d0-a006-bbc3e3c0c0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:23.158891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1d5e4-c14f-44d0-a006-bbc3e3c0c0df admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:23.161698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077ae35-7748-4d18-a1cf-00315738e8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:23.162631 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077ae35-7748-4d18-a1cf-00315738e8db admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.163128 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077ae35-7748-4d18-a1cf-00315738e8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.163622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077ae35-7748-4d18-a1cf-00315738e8db admin admin] PATH_INFO: `/v3/projects/d89a7bc869334c58bae86805b41314ff/users/2ce8f85c676447d5b15770c4c64d4237/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.171386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 800/1602] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:23.172850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf87100-1000-4a46-97e2-e3f49e9f0eb0 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.173277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf87100-1000-4a46-97e2-e3f49e9f0eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.173650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf87100-1000-4a46-97e2-e3f49e9f0eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.186623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077ae35-7748-4d18-a1cf-00315738e8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89a7bc869334c58bae86805b41314ff, user_id=2ce8f85c676447d5b15770c4c64d4237, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:23.190398 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077ae35-7748-4d18-a1cf-00315738e8db admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:23.203640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6bf87100-1000-4a46-97e2-e3f49e9f0eb0 None None] MFA Rules not processed for user `d3add387f18e4719b5cc91aaf09921ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:23.205261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6bf87100-1000-4a46-97e2-e3f49e9f0eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:23.211436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 803/1603] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:23 2022] PUT /identity/v3/projects/d89a7bc869334c58bae86805b41314ff/users/2ce8f85c676447d5b15770c4c64d4237/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:23.212450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077ae35-7748-4d18-a1cf-00315738e8db admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:23.266639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:23.289416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077ae35-7748-4d18-a1cf-00315738e8db admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:23.293895 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 801/1604] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:23.294965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf87100-1000-4a46-97e2-e3f49e9f0eb0 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:23.312343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef0d7f-91a6-4a54-9980-ecc094dae975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:23.312778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf87100-1000-4a46-97e2-e3f49e9f0eb0 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:23.312951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef0d7f-91a6-4a54-9980-ecc094dae975 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.313293 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef0d7f-91a6-4a54-9980-ecc094dae975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.314363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef0d7f-91a6-4a54-9980-ecc094dae975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.314998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef0d7f-91a6-4a54-9980-ecc094dae975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:23.319222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef0d7f-91a6-4a54-9980-ecc094dae975 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:23.326402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a6c4e-b07e-4ad0-84e6-ab4923ecd611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:23.327042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a6c4e-b07e-4ad0-84e6-ab4923ecd611 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.327360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a6c4e-b07e-4ad0-84e6-ab4923ecd611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.327571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a6c4e-b07e-4ad0-84e6-ab4923ecd611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.328279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a6c4e-b07e-4ad0-84e6-ab4923ecd611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:23.329882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a6c4e-b07e-4ad0-84e6-ab4923ecd611 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:23.356249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 802/1605] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:23.357127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a6c4e-b07e-4ad0-84e6-ab4923ecd611 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:23.378656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 804/1606] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:23 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:23.380282 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18cd1-64b3-4859-ae94-4d790928774c None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.380574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18cd1-64b3-4859-ae94-4d790928774c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.381458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d18cd1-64b3-4859-ae94-4d790928774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.405717 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-e5d18cd1-64b3-4859-ae94-4d790928774c None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:23.407424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e5d18cd1-64b3-4859-ae94-4d790928774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:23.439805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a6c4e-b07e-4ad0-84e6-ab4923ecd611 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:23.444130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:23.502205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 805/1607] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:23.503009 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d18cd1-64b3-4859-ae94-4d790928774c None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:23.516910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d18cd1-64b3-4859-ae94-4d790928774c None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:23.520446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3fb42-55e0-4f25-b766-523cc4f88057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:23.521439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3fb42-55e0-4f25-b766-523cc4f88057 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.522147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3fb42-55e0-4f25-b766-523cc4f88057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.522571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3fb42-55e0-4f25-b766-523cc4f88057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.522722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59cd6-900a-4548-bc8f-a59cc6a65095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:23.524124 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59cd6-900a-4548-bc8f-a59cc6a65095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.524440 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59cd6-900a-4548-bc8f-a59cc6a65095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.525219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59cd6-900a-4548-bc8f-a59cc6a65095 admin admin] PATH_INFO: `/v3/projects/a00266fbd9fc46298b9d1681341da9d5/users/7d9879cce3dc43178f196dbe9294c8b4/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.547800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3fb42-55e0-4f25-b766-523cc4f88057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:23.550957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3fb42-55e0-4f25-b766-523cc4f88057 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:23.551098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd59cd6-900a-4548-bc8f-a59cc6a65095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00266fbd9fc46298b9d1681341da9d5, user_id=7d9879cce3dc43178f196dbe9294c8b4, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:23.554042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd59cd6-900a-4548-bc8f-a59cc6a65095 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:23.577286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 803/1608] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:23.579735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 806/1609] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:23 2022] PUT /identity/v3/projects/a00266fbd9fc46298b9d1681341da9d5/users/7d9879cce3dc43178f196dbe9294c8b4/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:23.582194 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66a85-d15d-4e28-889f-8ab28e93312a None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.582497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66a85-d15d-4e28-889f-8ab28e93312a None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.584587 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e66a85-d15d-4e28-889f-8ab28e93312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.585102 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823878f7-a540-47f0-8d95-7aaeaf850a8f None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.585496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823878f7-a540-47f0-8d95-7aaeaf850a8f None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.586446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823878f7-a540-47f0-8d95-7aaeaf850a8f None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.588283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 807/1610] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 2 08:23:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:23:23.588929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823878f7-a540-47f0-8d95-7aaeaf850a8f None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:23.646531 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-69e66a85-d15d-4e28-889f-8ab28e93312a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:23.648515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-69e66a85-d15d-4e28-889f-8ab28e93312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:23.696792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823878f7-a540-47f0-8d95-7aaeaf850a8f None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:23.708336 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653725e9-52ab-439a-b427-ca12ac08c3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:23.710139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653725e9-52ab-439a-b427-ca12ac08c3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.710638 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653725e9-52ab-439a-b427-ca12ac08c3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.711412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653725e9-52ab-439a-b427-ca12ac08c3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.713649 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653725e9-52ab-439a-b427-ca12ac08c3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:23.716385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653725e9-52ab-439a-b427-ca12ac08c3d1 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:23.736245 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 808/1611] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:23.737704 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653725e9-52ab-439a-b427-ca12ac08c3d1 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:23.753068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653725e9-52ab-439a-b427-ca12ac08c3d1 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:23.761491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a97ee-b119-4e41-b09b-c504a4c94412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:23.762541 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a97ee-b119-4e41-b09b-c504a4c94412 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.762791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a97ee-b119-4e41-b09b-c504a4c94412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.763072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a97ee-b119-4e41-b09b-c504a4c94412 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.764064 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a97ee-b119-4e41-b09b-c504a4c94412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:23.767868 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a97ee-b119-4e41-b09b-c504a4c94412 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:23.804053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 804/1612] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:23.804876 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 809/1613] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:23 2022] POST /identity/v3/users => generated 288 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:23.806712 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c505b-331d-4b7a-8194-e5d1ac2e665b None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.807014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c505b-331d-4b7a-8194-e5d1ac2e665b None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.807293 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c505b-331d-4b7a-8194-e5d1ac2e665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.810300 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e66a85-d15d-4e28-889f-8ab28e93312a None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:23.849555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-858c505b-331d-4b7a-8194-e5d1ac2e665b None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:23.853787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-858c505b-331d-4b7a-8194-e5d1ac2e665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:23.863020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 810/1614] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:23.864197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb196a-64b2-47e5-94d4-ca724f920a71 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.864485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb196a-64b2-47e5-94d4-ca724f920a71 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.864758 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb196a-64b2-47e5-94d4-ca724f920a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.898154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:23.928337 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e66a85-d15d-4e28-889f-8ab28e93312a None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:23.931642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d9eb196a-64b2-47e5-94d4-ca724f920a71 None None] MFA Rules not processed for user `93143507a8784a30bc6b4a5e1f24f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:23.933244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d9eb196a-64b2-47e5-94d4-ca724f920a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:23.933538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7b65c-5a03-4c17-946d-180c11145911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:23.940562 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7b65c-5a03-4c17-946d-180c11145911 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:23.940867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7b65c-5a03-4c17-946d-180c11145911 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:23.941222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7b65c-5a03-4c17-946d-180c11145911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:23.965006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7b65c-5a03-4c17-946d-180c11145911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:23.966669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7b65c-5a03-4c17-946d-180c11145911 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:23.981702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 805/1615] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:23.982729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7b65c-5a03-4c17-946d-180c11145911 service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:23.999020 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7b65c-5a03-4c17-946d-180c11145911 service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:24.004580 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724250-b617-4107-8102-b36bbf2d0e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:24.005417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724250-b617-4107-8102-b36bbf2d0e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.005706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724250-b617-4107-8102-b36bbf2d0e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.005984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724250-b617-4107-8102-b36bbf2d0e3b admin admin] PATH_INFO: `/v3/projects/04ac37a2521343d5b06f91f187391e6c/users/ec8f5fdb20df4bd0b33413a50fc46f71/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.115605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:24.116463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724250-b617-4107-8102-b36bbf2d0e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ac37a2521343d5b06f91f187391e6c, user_id=ec8f5fdb20df4bd0b33413a50fc46f71, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:24.118054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 811/1616] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 2 08:23:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:24.118169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724250-b617-4107-8102-b36bbf2d0e3b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:24.118260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb196a-64b2-47e5-94d4-ca724f920a71 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:24.118260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb196a-64b2-47e5-94d4-ca724f920a71 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:24.123176 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 806/1617] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:23 2022] PUT /identity/v3/projects/04ac37a2521343d5b06f91f187391e6c/users/ec8f5fdb20df4bd0b33413a50fc46f71/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:24.125973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724250-b617-4107-8102-b36bbf2d0e3b admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:24.207616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84b34f-b9d6-4391-9f78-d2b56c41a99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:24.212500 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84b34f-b9d6-4391-9f78-d2b56c41a99f admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.213008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84b34f-b9d6-4391-9f78-d2b56c41a99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.213393 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84b34f-b9d6-4391-9f78-d2b56c41a99f admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.218750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84b34f-b9d6-4391-9f78-d2b56c41a99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:24.220670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84b34f-b9d6-4391-9f78-d2b56c41a99f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:24.242940 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724250-b617-4107-8102-b36bbf2d0e3b admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:24.247340 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 812/1618] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:24.248798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84b34f-b9d6-4391-9f78-d2b56c41a99f admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:24.251805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7a84b34f-b9d6-4391-9f78-d2b56c41a99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:24.252937 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac271a7-f359-40bc-8d4e-da5232bf2f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:24.254142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac271a7-f359-40bc-8d4e-da5232bf2f41 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.254617 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac271a7-f359-40bc-8d4e-da5232bf2f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.255252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac271a7-f359-40bc-8d4e-da5232bf2f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.266957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84b34f-b9d6-4391-9f78-d2b56c41a99f admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:24.275862 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac271a7-f359-40bc-8d4e-da5232bf2f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:24.278938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac271a7-f359-40bc-8d4e-da5232bf2f41 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:24.280520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8f392-e1e2-4257-afa6-bd2fe035cd0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:24.281239 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f392-e1e2-4257-afa6-bd2fe035cd0c service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.281540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f392-e1e2-4257-afa6-bd2fe035cd0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.281840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f392-e1e2-4257-afa6-bd2fe035cd0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.296338 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 807/1619] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:24.296997 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f392-e1e2-4257-afa6-bd2fe035cd0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:24.297719 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac271a7-f359-40bc-8d4e-da5232bf2f41 service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:24.298648 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f392-e1e2-4257-afa6-bd2fe035cd0c service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:24.315081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 813/1620] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:24.316898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8c5df-c0e6-4b97-be66-b05a1b849205 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.316898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8c5df-c0e6-4b97-be66-b05a1b849205 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.317122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8c5df-c0e6-4b97-be66-b05a1b849205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.349591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-26c8c5df-c0e6-4b97-be66-b05a1b849205 None None] MFA Rules not processed for user `ec8f5fdb20df4bd0b33413a50fc46f71`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:24.350872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-26c8c5df-c0e6-4b97-be66-b05a1b849205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:24.404458 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac271a7-f359-40bc-8d4e-da5232bf2f41 service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:24.411453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47425666-e9cf-4180-aff2-dc94b60c1d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:24.411680 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47425666-e9cf-4180-aff2-dc94b60c1d4b service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.412102 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47425666-e9cf-4180-aff2-dc94b60c1d4b service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.412442 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47425666-e9cf-4180-aff2-dc94b60c1d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.453806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 814/1621] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:24 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:24.455105 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8c5df-c0e6-4b97-be66-b05a1b849205 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:24.474865 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8c5df-c0e6-4b97-be66-b05a1b849205 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:24.480513 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44be0-de9c-4ae1-b4a0-152ad387f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:24.481324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44be0-de9c-4ae1-b4a0-152ad387f841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.481659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44be0-de9c-4ae1-b4a0-152ad387f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.481955 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44be0-de9c-4ae1-b4a0-152ad387f841 admin admin] PATH_INFO: `/v3/projects/9fee0393cc084646b63b119bc8815879/users/e0f8468382d34a83ae78969788e17846/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.500510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd44be0-de9c-4ae1-b4a0-152ad387f841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fee0393cc084646b63b119bc8815879, user_id=e0f8468382d34a83ae78969788e17846, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:24.503413 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd44be0-de9c-4ae1-b4a0-152ad387f841 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:24.505314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:24.512263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47425666-e9cf-4180-aff2-dc94b60c1d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:24.514693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47425666-e9cf-4180-aff2-dc94b60c1d4b service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:24.523869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 815/1622] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:24 2022] PUT /identity/v3/projects/9fee0393cc084646b63b119bc8815879/users/e0f8468382d34a83ae78969788e17846/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:24.525233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44be0-de9c-4ae1-b4a0-152ad387f841 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:24.531496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 808/1623] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:24.533226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47425666-e9cf-4180-aff2-dc94b60c1d4b service nova] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:24.548177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47425666-e9cf-4180-aff2-dc94b60c1d4b service nova] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:24.584200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:24.604190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44be0-de9c-4ae1-b4a0-152ad387f841 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:24.616693 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ad83-2c65-4ab5-9085-6994ad93101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:24.618133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ad83-2c65-4ab5-9085-6994ad93101d admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.618542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ad83-2c65-4ab5-9085-6994ad93101d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.619016 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81ad83-2c65-4ab5-9085-6994ad93101d admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.619955 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ad83-2c65-4ab5-9085-6994ad93101d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:24.623846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81ad83-2c65-4ab5-9085-6994ad93101d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:24.628530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f289ef9-5aac-466b-b37d-49a884ec33e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:24.629463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f289ef9-5aac-466b-b37d-49a884ec33e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.629754 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f289ef9-5aac-466b-b37d-49a884ec33e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.630099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f289ef9-5aac-466b-b37d-49a884ec33e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.630813 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f289ef9-5aac-466b-b37d-49a884ec33e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:24.633500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f289ef9-5aac-466b-b37d-49a884ec33e6 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:24.652767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 809/1624] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:24.659054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f289ef9-5aac-466b-b37d-49a884ec33e6 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:24.671244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f289ef9-5aac-466b-b37d-49a884ec33e6 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:24.678549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68829305-5c9a-4066-89be-6c8ec38d27bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:24.680570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68829305-5c9a-4066-89be-6c8ec38d27bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.680869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68829305-5c9a-4066-89be-6c8ec38d27bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.681207 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68829305-5c9a-4066-89be-6c8ec38d27bd admin admin] PATH_INFO: `/v3/projects/9fee0393cc084646b63b119bc8815879/users/e0f8468382d34a83ae78969788e17846/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.682823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 816/1625] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:24 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:24.683557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68829305-5c9a-4066-89be-6c8ec38d27bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fee0393cc084646b63b119bc8815879, user_id=e0f8468382d34a83ae78969788e17846, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:24.686606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ad83-2c65-4ab5-9085-6994ad93101d admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:24.692266 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68829305-5c9a-4066-89be-6c8ec38d27bd admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:24.717393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 810/1626] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:24 2022] PUT /identity/v3/projects/9fee0393cc084646b63b119bc8815879/users/e0f8468382d34a83ae78969788e17846/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:24.728264 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d7581-d0a3-4fbe-8349-10ef6908a406 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.728613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d7581-d0a3-4fbe-8349-10ef6908a406 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.728810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d7581-d0a3-4fbe-8349-10ef6908a406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.771751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81ad83-2c65-4ab5-9085-6994ad93101d admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:24.795177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-357d7581-d0a3-4fbe-8349-10ef6908a406 None None] MFA Rules not processed for user `e0f8468382d34a83ae78969788e17846`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:24.799352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-357d7581-d0a3-4fbe-8349-10ef6908a406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:24.858166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46b40b-72f1-4b15-8cdf-3c8365876337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:24.860778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46b40b-72f1-4b15-8cdf-3c8365876337 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.861284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46b40b-72f1-4b15-8cdf-3c8365876337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.862326 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46b40b-72f1-4b15-8cdf-3c8365876337 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.863897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46b40b-72f1-4b15-8cdf-3c8365876337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:24.871208 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46b40b-72f1-4b15-8cdf-3c8365876337 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:24.924446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 817/1627] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:24 2022] POST /identity/v3/users => generated 309 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:23:24.928286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46b40b-72f1-4b15-8cdf-3c8365876337 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:24.946602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46b40b-72f1-4b15-8cdf-3c8365876337 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:24.963582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f0f80-7008-42e6-985e-e60cfed122fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:24.966031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0f80-7008-42e6-985e-e60cfed122fc admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:24.966449 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0f80-7008-42e6-985e-e60cfed122fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:24.967740 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f0f80-7008-42e6-985e-e60cfed122fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:24.971031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f0f80-7008-42e6-985e-e60cfed122fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:24.974632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f0f80-7008-42e6-985e-e60cfed122fc admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:24.989544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 811/1628] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:25.003811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d7581-d0a3-4fbe-8349-10ef6908a406 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:25.009389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 818/1629] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:25.013657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f0f80-7008-42e6-985e-e60cfed122fc admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:25.040484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f0f80-7008-42e6-985e-e60cfed122fc admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:25.052525 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6fc8d-9891-41af-8363-1e5a4f7c0578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:25.053366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6fc8d-9891-41af-8363-1e5a4f7c0578 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:25.053902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6fc8d-9891-41af-8363-1e5a4f7c0578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:25.054228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6fc8d-9891-41af-8363-1e5a4f7c0578 admin admin] PATH_INFO: `/v3/projects/b168a8f1b1f740ca91ead6f3f14e4880/users/246ec109bc1549e4bf27b4e7e5be1a60/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:25.092241 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6fc8d-9891-41af-8363-1e5a4f7c0578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b168a8f1b1f740ca91ead6f3f14e4880, user_id=246ec109bc1549e4bf27b4e7e5be1a60, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:25.097833 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6fc8d-9891-41af-8363-1e5a4f7c0578 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:25.120497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d7581-d0a3-4fbe-8349-10ef6908a406 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:25.130020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 819/1630] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:25 2022] PUT /identity/v3/projects/b168a8f1b1f740ca91ead6f3f14e4880/users/246ec109bc1549e4bf27b4e7e5be1a60/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:25.131339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699e75-c975-4ea3-9208-38b1fea72754 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:25.131673 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699e75-c975-4ea3-9208-38b1fea72754 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:25.131950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699e75-c975-4ea3-9208-38b1fea72754 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:25.134107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 820/1631] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 2 08:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:23:25.134908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06699e75-c975-4ea3-9208-38b1fea72754 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:25.164717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:25.217664 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a6e2a-8037-4750-9ca9-176e81ff9fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:25.218967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a6e2a-8037-4750-9ca9-176e81ff9fec service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:25.219299 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a6e2a-8037-4750-9ca9-176e81ff9fec service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:25.219704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a6e2a-8037-4750-9ca9-176e81ff9fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:25.229083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:25.293484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06699e75-c975-4ea3-9208-38b1fea72754 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:25.302638 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c9d49-c0d7-43ac-9e7d-9c1d7e864256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:25.303600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c9d49-c0d7-43ac-9e7d-9c1d7e864256 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:25.304641 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c9d49-c0d7-43ac-9e7d-9c1d7e864256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:25.305350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c9d49-c0d7-43ac-9e7d-9c1d7e864256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:25.306754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c9d49-c0d7-43ac-9e7d-9c1d7e864256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:25.308919 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c9d49-c0d7-43ac-9e7d-9c1d7e864256 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:25.326036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 821/1632] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:25.332791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36152-2d02-4569-8ce8-fbcb2cc082dc None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:25.333321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36152-2d02-4569-8ce8-fbcb2cc082dc None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:25.333695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36152-2d02-4569-8ce8-fbcb2cc082dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:25.361243 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-8ba36152-2d02-4569-8ce8-fbcb2cc082dc None None] MFA Rules not processed for user `93143507a8784a30bc6b4a5e1f24f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:25.362948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-8ba36152-2d02-4569-8ce8-fbcb2cc082dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:25.469302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a6e2a-8037-4750-9ca9-176e81ff9fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:25.472004 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a6e2a-8037-4750-9ca9-176e81ff9fec service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:25.518841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 822/1633] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:23:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:25.519955 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36152-2d02-4569-8ce8-fbcb2cc082dc None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:25.521330 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 812/1634] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:25.524850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf83c36-65ce-4931-b1c9-8a802d03ff1c None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:25.525150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf83c36-65ce-4931-b1c9-8a802d03ff1c None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:25.525414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf83c36-65ce-4931-b1c9-8a802d03ff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:25.550297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36152-2d02-4569-8ce8-fbcb2cc082dc None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:25.563533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f860e4-2a77-49ce-b8a9-81659168a3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:25.566699 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f860e4-2a77-49ce-b8a9-81659168a3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:25.567374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f860e4-2a77-49ce-b8a9-81659168a3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:25.567374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f860e4-2a77-49ce-b8a9-81659168a3d9 admin admin] PATH_INFO: `/v3/projects/b168a8f1b1f740ca91ead6f3f14e4880/users/246ec109bc1549e4bf27b4e7e5be1a60/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:25.572600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f860e4-2a77-49ce-b8a9-81659168a3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b168a8f1b1f740ca91ead6f3f14e4880, user_id=246ec109bc1549e4bf27b4e7e5be1a60, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:25.582998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f860e4-2a77-49ce-b8a9-81659168a3d9 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:25.607103 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-0cf83c36-65ce-4931-b1c9-8a802d03ff1c None None] MFA Rules not processed for user `e9bd6a66cbc94a5686d96957a9724ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:25.608365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0cf83c36-65ce-4931-b1c9-8a802d03ff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:25.624013 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 823/1635] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:25 2022] PUT /identity/v3/projects/b168a8f1b1f740ca91ead6f3f14e4880/users/246ec109bc1549e4bf27b4e7e5be1a60/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:25.626476 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f860e4-2a77-49ce-b8a9-81659168a3d9 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:25.782556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f860e4-2a77-49ce-b8a9-81659168a3d9 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:25.795880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b89d2-2e8d-4036-be53-7b3f18cae8e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:25.799099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b89d2-2e8d-4036-be53-7b3f18cae8e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:25.799480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b89d2-2e8d-4036-be53-7b3f18cae8e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:25.799752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b89d2-2e8d-4036-be53-7b3f18cae8e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:25.806884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 813/1636] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:25 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:25.813047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72b2f8-79ab-450d-b5be-9f96ffd26e1b None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:25.813395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72b2f8-79ab-450d-b5be-9f96ffd26e1b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:25.813691 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72b2f8-79ab-450d-b5be-9f96ffd26e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:25.879829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-bb72b2f8-79ab-450d-b5be-9f96ffd26e1b None None] MFA Rules not processed for user `246ec109bc1549e4bf27b4e7e5be1a60`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:25.881359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-bb72b2f8-79ab-450d-b5be-9f96ffd26e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:25.972154 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:25.978488 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:25.997011 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b89d2-2e8d-4036-be53-7b3f18cae8e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:26.000349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b89d2-2e8d-4036-be53-7b3f18cae8e9 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:26.029012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 824/1637] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:26.029900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b89d2-2e8d-4036-be53-7b3f18cae8e9 service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:26.042213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 814/1638] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:25 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:26.051941 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72b2f8-79ab-450d-b5be-9f96ffd26e1b None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:26.052396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b89d2-2e8d-4036-be53-7b3f18cae8e9 service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:26.060597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe7833-cb76-4536-b19b-c3d25123065d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:26.063136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe7833-cb76-4536-b19b-c3d25123065d service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:26.064355 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe7833-cb76-4536-b19b-c3d25123065d service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:26.064847 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe7833-cb76-4536-b19b-c3d25123065d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:26.208565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe7833-cb76-4536-b19b-c3d25123065d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:26.210122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe7833-cb76-4536-b19b-c3d25123065d service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:26.239142 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 825/1639] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:26.251205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72b2f8-79ab-450d-b5be-9f96ffd26e1b None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:26.266270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc9d0b-384c-480a-930b-741f7f553a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:26.267520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9d0b-384c-480a-930b-741f7f553a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:26.267968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9d0b-384c-480a-930b-741f7f553a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:26.268412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9d0b-384c-480a-930b-741f7f553a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:26.269661 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc9d0b-384c-480a-930b-741f7f553a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:26.272645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc9d0b-384c-480a-930b-741f7f553a58 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:26.364537 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 815/1640] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:26 2022] POST /identity/v3/projects => generated 403 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:26.368990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe7833-cb76-4536-b19b-c3d25123065d service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:26.391572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe7833-cb76-4536-b19b-c3d25123065d service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:26.539994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9cee-4637-4d33-a407-fcffc68f2aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:26.540889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9cee-4637-4d33-a407-fcffc68f2aee admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:26.541175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9cee-4637-4d33-a407-fcffc68f2aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:26.541671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9cee-4637-4d33-a407-fcffc68f2aee admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:26.542579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d9cee-4637-4d33-a407-fcffc68f2aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:26.546163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d9cee-4637-4d33-a407-fcffc68f2aee admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:26.586319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 826/1641] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:26 2022] POST /identity/v3/users => generated 308 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:26.590420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc9d0b-384c-480a-930b-741f7f553a58 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:26.607559 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc9d0b-384c-480a-930b-741f7f553a58 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:26.621299 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfde2e8-8f16-497b-b293-34a108c9843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:26.622063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde2e8-8f16-497b-b293-34a108c9843d admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:26.622443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde2e8-8f16-497b-b293-34a108c9843d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:26.625190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfde2e8-8f16-497b-b293-34a108c9843d admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:26.626416 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfde2e8-8f16-497b-b293-34a108c9843d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:26.630464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfde2e8-8f16-497b-b293-34a108c9843d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:26.672389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 816/1642] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:26.674221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9cee-4637-4d33-a407-fcffc68f2aee admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:26.692403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9cee-4637-4d33-a407-fcffc68f2aee admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:26.710180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ca732-aa74-46e8-8173-b0ef4135902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:26.711002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ca732-aa74-46e8-8173-b0ef4135902d admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:26.711428 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ca732-aa74-46e8-8173-b0ef4135902d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:26.713750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ca732-aa74-46e8-8173-b0ef4135902d admin admin] PATH_INFO: `/v3/projects/5b14a4fdad7446e5a65178a493462de1/users/81600cb701eb4efcaaee3d533e5c9229/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:26.734613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfde2e8-8f16-497b-b293-34a108c9843d admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:26.829559 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ca732-aa74-46e8-8173-b0ef4135902d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b14a4fdad7446e5a65178a493462de1, user_id=81600cb701eb4efcaaee3d533e5c9229, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:26.837387 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ca732-aa74-46e8-8173-b0ef4135902d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:26.873738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 827/1643] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:26 2022] PUT /identity/v3/projects/5b14a4fdad7446e5a65178a493462de1/users/81600cb701eb4efcaaee3d533e5c9229/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:26.875294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ca732-aa74-46e8-8173-b0ef4135902d admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:26.962811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfde2e8-8f16-497b-b293-34a108c9843d admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:27.001095 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:27.014339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ca732-aa74-46e8-8173-b0ef4135902d admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:27.029164 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183859ef-b826-43bc-8a3a-7d7ff07249fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:27.030755 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183859ef-b826-43bc-8a3a-7d7ff07249fb admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:27.031043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183859ef-b826-43bc-8a3a-7d7ff07249fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:27.033454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183859ef-b826-43bc-8a3a-7d7ff07249fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:27.039222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183859ef-b826-43bc-8a3a-7d7ff07249fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:27.043823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183859ef-b826-43bc-8a3a-7d7ff07249fb admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:27.080205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 828/1644] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:27.081686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183859ef-b826-43bc-8a3a-7d7ff07249fb admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:27.094699 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd03f7-b14d-4137-a09b-94a20eb1cd89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:27.096075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd03f7-b14d-4137-a09b-94a20eb1cd89 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:27.096670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd03f7-b14d-4137-a09b-94a20eb1cd89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:27.097314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd03f7-b14d-4137-a09b-94a20eb1cd89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:27.136915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183859ef-b826-43bc-8a3a-7d7ff07249fb admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:27.152218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b7e79-dbfc-4bdf-bc36-185129a4438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:27.159521 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7e79-dbfc-4bdf-bc36-185129a4438f admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:27.159901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7e79-dbfc-4bdf-bc36-185129a4438f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:27.160212 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b7e79-dbfc-4bdf-bc36-185129a4438f admin admin] PATH_INFO: `/v3/projects/5b14a4fdad7446e5a65178a493462de1/users/81600cb701eb4efcaaee3d533e5c9229/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:27.169257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b7e79-dbfc-4bdf-bc36-185129a4438f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b14a4fdad7446e5a65178a493462de1, user_id=81600cb701eb4efcaaee3d533e5c9229, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:27.183984 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b7e79-dbfc-4bdf-bc36-185129a4438f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:27.193596 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:27.234512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 829/1645] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:27 2022] PUT /identity/v3/projects/5b14a4fdad7446e5a65178a493462de1/users/81600cb701eb4efcaaee3d533e5c9229/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:27.277243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd03f7-b14d-4137-a09b-94a20eb1cd89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:27.278785 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd03f7-b14d-4137-a09b-94a20eb1cd89 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:27.290348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 817/1646] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:26 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:27.922832 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b7e79-dbfc-4bdf-bc36-185129a4438f admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:28.124416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b7e79-dbfc-4bdf-bc36-185129a4438f admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:28.130296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026d3b0-0939-499d-b001-6189430b49f2 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:28.130805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026d3b0-0939-499d-b001-6189430b49f2 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:28.131687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026d3b0-0939-499d-b001-6189430b49f2 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:28.133206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 818/1647] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 2 08:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:23:28.141451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:28.144062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:28.144492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:28.145232 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] PATH_INFO: `/v3/users/ec8f5fdb20df4bd0b33413a50fc46f71` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:28.148545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8f5fdb20df4bd0b33413a50fc46f71)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:28.149599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: WARNING py.warnings [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:23:28.149599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: warnings.warn(msg) Aug 02 08:23:28.149599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: Aug 02 08:23:28.150862 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:28.154265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ce677-2887-44dd-bec7-dfebbf092fc4 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:28.154586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ce677-2887-44dd-bec7-dfebbf092fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:28.155025 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ce677-2887-44dd-bec7-dfebbf092fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:28.201723 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-768ce677-2887-44dd-bec7-dfebbf092fc4 None None] MFA Rules not processed for user `93143507a8784a30bc6b4a5e1f24f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:28.208597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-768ce677-2887-44dd-bec7-dfebbf092fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:28.358996 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8f5fdb20df4bd0b33413a50fc46f71'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:28.404672 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8f5fdb20df4bd0b33413a50fc46f71'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:28.435759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8f5fdb20df4bd0b33413a50fc46f71'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:28.436088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 819/1648] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 2 08:23:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:23:28.437902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8f5fdb20df4bd0b33413a50fc46f71'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:28.441848 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c90c-30db-4d42-8070-e14e00a35000 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:28.442196 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c90c-30db-4d42-8070-e14e00a35000 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:28.442485 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c90c-30db-4d42-8070-e14e00a35000 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:28.449542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 820/1649] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 2 08:23:28 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:23:28.462655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb2e55-77bc-4820-83e1-abe1ff40815e None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:28.462655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb2e55-77bc-4820-83e1-abe1ff40815e None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:28.462655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb2e55-77bc-4820-83e1-abe1ff40815e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:28.534486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-503fb78a-cf58-48fc-a8c8-defbaba473aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8f5fdb20df4bd0b33413a50fc46f71'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:28.553753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6deb2e55-77bc-4820-83e1-abe1ff40815e None None] MFA Rules not processed for user `93143507a8784a30bc6b4a5e1f24f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:28.557114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6deb2e55-77bc-4820-83e1-abe1ff40815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:28.625313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 830/1650] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:23:27 2022] DELETE /identity/v3/users/ec8f5fdb20df4bd0b33413a50fc46f71 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:28.625313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801640-5883-4a93-bf78-94d3034e8267 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:28.625313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801640-5883-4a93-bf78-94d3034e8267 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:28.625313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f801640-5883-4a93-bf78-94d3034e8267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:28.625313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-9f801640-5883-4a93-bf78-94d3034e8267 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:28.625313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9f801640-5883-4a93-bf78-94d3034e8267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:28.761745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 821/1651] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:23:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:28.770508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb2e55-77bc-4820-83e1-abe1ff40815e None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:28.775393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6deb2e55-77bc-4820-83e1-abe1ff40815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:28.776052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:28.805040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 831/1652] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:28.836304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f801640-5883-4a93-bf78-94d3034e8267 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:28.837981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9f801640-5883-4a93-bf78-94d3034e8267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:28.912000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:28.920449 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb2e55-77bc-4820-83e1-abe1ff40815e None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:28.927297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb874ee4-fe8b-4da9-9b8b-b71c845be503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:28.928499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb874ee4-fe8b-4da9-9b8b-b71c845be503 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:28.928806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb874ee4-fe8b-4da9-9b8b-b71c845be503 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:28.929852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb874ee4-fe8b-4da9-9b8b-b71c845be503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:28.941505 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f801640-5883-4a93-bf78-94d3034e8267 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:28.947362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb197616-82be-46e0-a071-30ba48c1be10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:28.949220 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197616-82be-46e0-a071-30ba48c1be10 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:28.949702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197616-82be-46e0-a071-30ba48c1be10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:28.950285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197616-82be-46e0-a071-30ba48c1be10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:28.963615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb874ee4-fe8b-4da9-9b8b-b71c845be503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:28.964363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb197616-82be-46e0-a071-30ba48c1be10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:28.965237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb874ee4-fe8b-4da9-9b8b-b71c845be503 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:28.966272 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb197616-82be-46e0-a071-30ba48c1be10 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:28.981508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 832/1653] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:23:28.985287 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 822/1654] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:30.377511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb197616-82be-46e0-a071-30ba48c1be10 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:30.380062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fb197616-82be-46e0-a071-30ba48c1be10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:30.406768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb197616-82be-46e0-a071-30ba48c1be10 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:30.421950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:30.422775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:30.423555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:30.424071 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] PATH_INFO: `/v3/projects/04ac37a2521343d5b06f91f187391e6c` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:30.425865 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ac37a2521343d5b06f91f187391e6c)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:30.431800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:30.525781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ac37a2521343d5b06f91f187391e6c', 'request_id': 'req-d48d2534-3a08-4e8a-a488-5d0befa33a64'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:30.537213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ac37a2521343d5b06f91f187391e6c', 'request_id': 'req-d48d2534-3a08-4e8a-a488-5d0befa33a64'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:30.548487 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ac37a2521343d5b06f91f187391e6c', 'request_id': 'req-d48d2534-3a08-4e8a-a488-5d0befa33a64'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:30.578136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] The token cache is being invalidate because project 04ac37a2521343d5b06f91f187391e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:23:30.578476 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:30.579839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-d48d2534-3a08-4e8a-a488-5d0befa33a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:30.587081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb874ee4-fe8b-4da9-9b8b-b71c845be503 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:30.587592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 833/1655] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:23:30 2022] DELETE /identity/v3/projects/04ac37a2521343d5b06f91f187391e6c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:30.610862 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb874ee4-fe8b-4da9-9b8b-b71c845be503 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:30.721063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:30.721624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:30.722281 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:30.722800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] PATH_INFO: `/v3/users/246ec109bc1549e4bf27b4e7e5be1a60` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:30.724326 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=246ec109bc1549e4bf27b4e7e5be1a60)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:30.726853 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:30.848771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246ec109bc1549e4bf27b4e7e5be1a60'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:30.850316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246ec109bc1549e4bf27b4e7e5be1a60'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:30.869034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246ec109bc1549e4bf27b4e7e5be1a60'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:30.918621 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246ec109bc1549e4bf27b4e7e5be1a60'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:30.920628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246ec109bc1549e4bf27b4e7e5be1a60'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:30.947992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 823/1656] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:23:30 2022] DELETE /identity/v3/users/246ec109bc1549e4bf27b4e7e5be1a60 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:23:31.609776 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4665f7-1922-45c1-b021-f458d178ea8d None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:31.611020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4665f7-1922-45c1-b021-f458d178ea8d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:31.611551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4665f7-1922-45c1-b021-f458d178ea8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:31.679950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-ad4665f7-1922-45c1-b021-f458d178ea8d None None] MFA Rules not processed for user `81600cb701eb4efcaaee3d533e5c9229`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:31.683553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ad4665f7-1922-45c1-b021-f458d178ea8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:31.800369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 834/1657] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:31 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:33.049835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:33.051337 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:33.192239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36396fe-3b03-4ccd-8536-ff18afb1edbe admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:33.228745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:33.229729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:33.230039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:33.230331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] PATH_INFO: `/v3/projects/b168a8f1b1f740ca91ead6f3f14e4880` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:33.235527 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b168a8f1b1f740ca91ead6f3f14e4880)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:33.242220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: WARNING py.warnings [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 08:23:33.242220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: warnings.warn(msg) Aug 02 08:23:33.242220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: Aug 02 08:23:33.243956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:33.300528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:33.369004 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b168a8f1b1f740ca91ead6f3f14e4880', 'request_id': 'req-7274da6b-075f-42ed-9645-12ea312e6d29'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:33.385165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b168a8f1b1f740ca91ead6f3f14e4880', 'request_id': 'req-7274da6b-075f-42ed-9645-12ea312e6d29'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:33.393308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b168a8f1b1f740ca91ead6f3f14e4880', 'request_id': 'req-7274da6b-075f-42ed-9645-12ea312e6d29'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:33.413353 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] The token cache is being invalidate because project b168a8f1b1f740ca91ead6f3f14e4880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:23:33.417002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:33.417761 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7274da6b-075f-42ed-9645-12ea312e6d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:33.419452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 824/1658] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:23:33 2022] DELETE /identity/v3/projects/b168a8f1b1f740ca91ead6f3f14e4880 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:33.424657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68efa91-5896-4e9a-ba08-bbabf1bb320c None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:33.425202 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68efa91-5896-4e9a-ba08-bbabf1bb320c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:33.425202 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68efa91-5896-4e9a-ba08-bbabf1bb320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:33.465093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-e68efa91-5896-4e9a-ba08-bbabf1bb320c None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:33.467080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e68efa91-5896-4e9a-ba08-bbabf1bb320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:33.477452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:33.595785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 835/1659] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:33.606002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74d261-95f8-439b-9b35-84706f20ecd0 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:33.606864 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74d261-95f8-439b-9b35-84706f20ecd0 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:33.607254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74d261-95f8-439b-9b35-84706f20ecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:33.662889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6c74d261-95f8-439b-9b35-84706f20ecd0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:33.670680 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6c74d261-95f8-439b-9b35-84706f20ecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:33.692375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 825/1660] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:33.696591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68efa91-5896-4e9a-ba08-bbabf1bb320c None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:33.718689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68efa91-5896-4e9a-ba08-bbabf1bb320c None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:33.740678 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c4d0a-57e4-4245-9b07-ccaac86c2726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:33.741870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4d0a-57e4-4245-9b07-ccaac86c2726 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:33.742567 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4d0a-57e4-4245-9b07-ccaac86c2726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:33.743077 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c4d0a-57e4-4245-9b07-ccaac86c2726 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:33.744045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c4d0a-57e4-4245-9b07-ccaac86c2726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:33.744619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c4d0a-57e4-4245-9b07-ccaac86c2726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:33.746557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c4d0a-57e4-4245-9b07-ccaac86c2726 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:33.784130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 836/1661] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:23:33.784913 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74d261-95f8-439b-9b35-84706f20ecd0 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:33.802042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74d261-95f8-439b-9b35-84706f20ecd0 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:33.807009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e7e97-9130-42e7-a199-376bd4369d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:33.807660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7e97-9130-42e7-a199-376bd4369d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:33.809484 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7e97-9130-42e7-a199-376bd4369d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:33.809798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e7e97-9130-42e7-a199-376bd4369d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:33.810525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e7e97-9130-42e7-a199-376bd4369d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:33.818263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e7e97-9130-42e7-a199-376bd4369d04 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:33.872883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 826/1662] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:33 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:33.875237 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c4d0a-57e4-4245-9b07-ccaac86c2726 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:33.908965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c4d0a-57e4-4245-9b07-ccaac86c2726 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:34.032069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3ce15-8c19-4417-b825-7c840bf90c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:34.032796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3ce15-8c19-4417-b825-7c840bf90c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:34.033112 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3ce15-8c19-4417-b825-7c840bf90c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:34.034503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3ce15-8c19-4417-b825-7c840bf90c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:34.035908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3ce15-8c19-4417-b825-7c840bf90c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:34.040350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3ce15-8c19-4417-b825-7c840bf90c59 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:34.060275 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154418e4-82de-4ed1-b9c4-86728c63012a None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:34.061250 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154418e4-82de-4ed1-b9c4-86728c63012a None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:34.061678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154418e4-82de-4ed1-b9c4-86728c63012a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:34.083651 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 837/1663] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:33 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:23:34.087653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3ce15-8c19-4417-b825-7c840bf90c59 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:34.111740 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3ce15-8c19-4417-b825-7c840bf90c59 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:34.118304 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0359739-ffe9-4629-9499-a647cff80918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:34.119213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359739-ffe9-4629-9499-a647cff80918 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:34.119976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359739-ffe9-4629-9499-a647cff80918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:34.119976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0359739-ffe9-4629-9499-a647cff80918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:34.121019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0359739-ffe9-4629-9499-a647cff80918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:34.122856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0359739-ffe9-4629-9499-a647cff80918 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:34.127099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-154418e4-82de-4ed1-b9c4-86728c63012a None None] MFA Rules not processed for user `4a3a53f881ed4686a8dce1fb2b6df04d`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:34.128368 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-154418e4-82de-4ed1-b9c4-86728c63012a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:34.138700 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 838/1664] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:34.150883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0359739-ffe9-4629-9499-a647cff80918 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:34.176327 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0359739-ffe9-4629-9499-a647cff80918 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:34.194460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf56a0-d681-4747-9153-093f11e47119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:34.195447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf56a0-d681-4747-9153-093f11e47119 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:34.195946 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf56a0-d681-4747-9153-093f11e47119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:34.196617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf56a0-d681-4747-9153-093f11e47119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:34.197598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf56a0-d681-4747-9153-093f11e47119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:34.199938 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf56a0-d681-4747-9153-093f11e47119 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:34.231159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 839/1665] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:34.235818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf56a0-d681-4747-9153-093f11e47119 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:34.265134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 827/1666] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:34.266528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf56a0-d681-4747-9153-093f11e47119 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:34.273624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154418e4-82de-4ed1-b9c4-86728c63012a None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:34.274886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-154418e4-82de-4ed1-b9c4-86728c63012a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:34.276896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b63385-d468-4456-a461-9e6902365b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:34.277496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b63385-d468-4456-a461-9e6902365b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:34.277776 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b63385-d468-4456-a461-9e6902365b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:34.278888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b63385-d468-4456-a461-9e6902365b9a admin admin] PATH_INFO: `/v3/projects/2f4977898f32432f855d02aac9c1fb33/users/edee704975674af798702284cdd68e56/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:34.312309 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b63385-d468-4456-a461-9e6902365b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4977898f32432f855d02aac9c1fb33, user_id=edee704975674af798702284cdd68e56, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:34.322196 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b63385-d468-4456-a461-9e6902365b9a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:34.369326 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 840/1667] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:34 2022] PUT /identity/v3/projects/2f4977898f32432f855d02aac9c1fb33/users/edee704975674af798702284cdd68e56/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:34.379754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049aa3-633d-44eb-907c-b3182a6fc7e2 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:34.380046 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049aa3-633d-44eb-907c-b3182a6fc7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:34.380314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049aa3-633d-44eb-907c-b3182a6fc7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:34.381511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:34.407987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154418e4-82de-4ed1-b9c4-86728c63012a None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:34.443924 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-96049aa3-633d-44eb-907c-b3182a6fc7e2 None None] MFA Rules not processed for user `edee704975674af798702284cdd68e56`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:34.445248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-96049aa3-633d-44eb-907c-b3182a6fc7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:34.519011 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:34.564036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f812a-f0e2-43d1-8221-2b6a7a4b938b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:34.565021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f812a-f0e2-43d1-8221-2b6a7a4b938b service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:34.565487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f812a-f0e2-43d1-8221-2b6a7a4b938b service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:34.565935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f812a-f0e2-43d1-8221-2b6a7a4b938b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:34.618645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 841/1668] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:23:34.619583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96049aa3-633d-44eb-907c-b3182a6fc7e2 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:34.660860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f812a-f0e2-43d1-8221-2b6a7a4b938b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:34.662802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f812a-f0e2-43d1-8221-2b6a7a4b938b service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:34.675279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 828/1669] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:34.743155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96049aa3-633d-44eb-907c-b3182a6fc7e2 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:34.751177 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd389b9b-7621-4cf6-babd-082489350e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:34.752059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389b9b-7621-4cf6-babd-082489350e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:34.752599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389b9b-7621-4cf6-babd-082489350e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:34.753039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd389b9b-7621-4cf6-babd-082489350e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:34.753866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd389b9b-7621-4cf6-babd-082489350e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:34.756296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd389b9b-7621-4cf6-babd-082489350e25 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:34.811646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 842/1670] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:34 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:34.812324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f812a-f0e2-43d1-8221-2b6a7a4b938b service nova] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:34.831694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f812a-f0e2-43d1-8221-2b6a7a4b938b service nova] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:34.934212 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce09d0-d918-4bbd-8d7c-42a6b978a7f0 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:34.935585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce09d0-d918-4bbd-8d7c-42a6b978a7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:34.936224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce09d0-d918-4bbd-8d7c-42a6b978a7f0 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:34.938885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 843/1671] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 08:23:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:23:34.943645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da95fd-7761-4cca-96cc-89432182a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:34.944220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da95fd-7761-4cca-96cc-89432182a8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:34.945984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da95fd-7761-4cca-96cc-89432182a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:34.946329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da95fd-7761-4cca-96cc-89432182a8b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:34.947033 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da95fd-7761-4cca-96cc-89432182a8b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:34.957257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da95fd-7761-4cca-96cc-89432182a8b4 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:34.969490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca9d4-47d2-4708-9901-452ffbdb9e6c None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:34.970041 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca9d4-47d2-4708-9901-452ffbdb9e6c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:34.970596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca9d4-47d2-4708-9901-452ffbdb9e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:35.008171 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 829/1672] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:34 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:23:35.014525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da95fd-7761-4cca-96cc-89432182a8b4 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:35.016622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-1cbca9d4-47d2-4708-9901-452ffbdb9e6c None None] MFA Rules not processed for user `3318842c46ec4c6d9b7b1f55c9fab62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:35.018317 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1cbca9d4-47d2-4708-9901-452ffbdb9e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:35.037158 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da95fd-7761-4cca-96cc-89432182a8b4 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:35.051532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab269e1-52af-4f7e-a39e-d786b770c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:35.052257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab269e1-52af-4f7e-a39e-d786b770c0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:35.053354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab269e1-52af-4f7e-a39e-d786b770c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:35.054645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab269e1-52af-4f7e-a39e-d786b770c0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:35.056930 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab269e1-52af-4f7e-a39e-d786b770c0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:35.060072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab269e1-52af-4f7e-a39e-d786b770c0e0 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:35.086555 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 830/1673] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:35.090643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab269e1-52af-4f7e-a39e-d786b770c0e0 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:35.120382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab269e1-52af-4f7e-a39e-d786b770c0e0 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:35.132521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f18324-b631-4791-b505-d66dc5a47218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:35.135550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18324-b631-4791-b505-d66dc5a47218 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:35.135697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18324-b631-4791-b505-d66dc5a47218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:35.137429 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f18324-b631-4791-b505-d66dc5a47218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:35.138997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f18324-b631-4791-b505-d66dc5a47218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:35.150816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f18324-b631-4791-b505-d66dc5a47218 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:35.200914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 831/1674] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:35.203896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f18324-b631-4791-b505-d66dc5a47218 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:35.213632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 844/1675] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 08:23:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:35.217845 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:35.224501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f18324-b631-4791-b505-d66dc5a47218 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:35.231865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f900e-43c1-4f07-b7b3-c80c6cfad6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:35.232797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f900e-43c1-4f07-b7b3-c80c6cfad6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:35.233690 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f900e-43c1-4f07-b7b3-c80c6cfad6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:35.234235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f900e-43c1-4f07-b7b3-c80c6cfad6a5 admin admin] PATH_INFO: `/v3/projects/9973e894fe6744cab6d0a58bfcfc34ea/users/914025a8155144c08d6932ecc94bb0d0/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:35.254171 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f900e-43c1-4f07-b7b3-c80c6cfad6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9973e894fe6744cab6d0a58bfcfc34ea, user_id=914025a8155144c08d6932ecc94bb0d0, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:35.257639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f900e-43c1-4f07-b7b3-c80c6cfad6a5 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:35.282421 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9411f-1fc0-4a30-b2f3-d60d7650fabb None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:35.282937 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9411f-1fc0-4a30-b2f3-d60d7650fabb None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:35.283359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9411f-1fc0-4a30-b2f3-d60d7650fabb None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:35.285711 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 845/1676] 10.222.0.57 () {54 vars in 961 bytes} [Tue Aug 2 08:23:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:23:35.297213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ba86e-e4e3-450d-aa90-4abfffc29a8a None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:35.297772 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ba86e-e4e3-450d-aa90-4abfffc29a8a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:35.298233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ba86e-e4e3-450d-aa90-4abfffc29a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:35.338083 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 832/1677] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:35 2022] PUT /identity/v3/projects/9973e894fe6744cab6d0a58bfcfc34ea/users/914025a8155144c08d6932ecc94bb0d0/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:35.359845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-6e7ba86e-e4e3-450d-aa90-4abfffc29a8a None None] MFA Rules not processed for user `3318842c46ec4c6d9b7b1f55c9fab62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:35.362181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-6e7ba86e-e4e3-450d-aa90-4abfffc29a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:35.370426 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a17fa9-138f-4752-b70b-65c109b66f93 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:35.370713 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a17fa9-138f-4752-b70b-65c109b66f93 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:35.370987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a17fa9-138f-4752-b70b-65c109b66f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:35.449235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:35.486727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-c6a17fa9-138f-4752-b70b-65c109b66f93 None None] MFA Rules not processed for user `914025a8155144c08d6932ecc94bb0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:35.489159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c6a17fa9-138f-4752-b70b-65c109b66f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:35.492858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 846/1678] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Aug 2 08:23:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 02 08:23:35.494218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4fa1-1023-4ce8-8a2d-ea83346a6203 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:35.494579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4fa1-1023-4ce8-8a2d-ea83346a6203 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:35.494862 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f4fa1-1023-4ce8-8a2d-ea83346a6203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:35.557686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-1e3f4fa1-1023-4ce8-8a2d-ea83346a6203 None None] MFA Rules not processed for user `dc97bab8d9c943ee968db907513cc0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:35.561581 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1e3f4fa1-1023-4ce8-8a2d-ea83346a6203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:35.651252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 833/1679] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:35.652156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a17fa9-138f-4752-b70b-65c109b66f93 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:35.685813 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a17fa9-138f-4752-b70b-65c109b66f93 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:35.698942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ff52c-4070-4577-ac2b-2bdd8609cfaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3318842c46ec4c6d9b7b1f55c9fab62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:35.701099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff52c-4070-4577-ac2b-2bdd8609cfaa service placement] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:35.703230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff52c-4070-4577-ac2b-2bdd8609cfaa service placement] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:35.703809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ff52c-4070-4577-ac2b-2bdd8609cfaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:35.743205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ff52c-4070-4577-ac2b-2bdd8609cfaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:35.747832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ff52c-4070-4577-ac2b-2bdd8609cfaa service placement] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:35.760773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 847/1680] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:35.763012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f4fa1-1023-4ce8-8a2d-ea83346a6203 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:35.780538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 834/1681] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:35.784752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14d95-be5f-4d23-bfa2-9e2e716f4906 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:35.785810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14d95-be5f-4d23-bfa2-9e2e716f4906 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:35.786981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14d95-be5f-4d23-bfa2-9e2e716f4906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:35.837318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-47a14d95-be5f-4d23-bfa2-9e2e716f4906 None None] MFA Rules not processed for user `dc97bab8d9c943ee968db907513cc0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:35.840334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-47a14d95-be5f-4d23-bfa2-9e2e716f4906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:35.852431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 835/1682] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:35.864525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14d95-be5f-4d23-bfa2-9e2e716f4906 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:35.916612 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f4fa1-1023-4ce8-8a2d-ea83346a6203 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:35.922444 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79227d50-8412-473c-ab4e-2c7e4a99d206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:35.923084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79227d50-8412-473c-ab4e-2c7e4a99d206 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:35.923366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79227d50-8412-473c-ab4e-2c7e4a99d206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:35.923641 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79227d50-8412-473c-ab4e-2c7e4a99d206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:35.924595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79227d50-8412-473c-ab4e-2c7e4a99d206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:35.926647 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79227d50-8412-473c-ab4e-2c7e4a99d206 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:35.967633 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 848/1683] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:35 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:35.971567 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79227d50-8412-473c-ab4e-2c7e4a99d206 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:36.010875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14d95-be5f-4d23-bfa2-9e2e716f4906 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:36.085601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79227d50-8412-473c-ab4e-2c7e4a99d206 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:36.105316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c940a73-c7b7-4929-8b70-0e975cfb3904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:36.106570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940a73-c7b7-4929-8b70-0e975cfb3904 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:36.107098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940a73-c7b7-4929-8b70-0e975cfb3904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:36.108124 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c940a73-c7b7-4929-8b70-0e975cfb3904 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:36.109101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c940a73-c7b7-4929-8b70-0e975cfb3904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:36.125693 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c940a73-c7b7-4929-8b70-0e975cfb3904 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:36.146240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:36.147016 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:36.177424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 849/1684] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:35 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:23:36.179219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c940a73-c7b7-4929-8b70-0e975cfb3904 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:36.180236 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058148da-41da-4ee6-9b14-ab681c21a2b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:36.181089 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058148da-41da-4ee6-9b14-ab681c21a2b1 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:36.181442 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058148da-41da-4ee6-9b14-ab681c21a2b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:36.181779 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058148da-41da-4ee6-9b14-ab681c21a2b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:36.193416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c940a73-c7b7-4929-8b70-0e975cfb3904 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:36.199588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df10dc-7e35-469c-a33e-8304e1032802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:36.200953 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df10dc-7e35-469c-a33e-8304e1032802 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:36.201310 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df10dc-7e35-469c-a33e-8304e1032802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:36.201801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df10dc-7e35-469c-a33e-8304e1032802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:36.202820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df10dc-7e35-469c-a33e-8304e1032802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:36.204942 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df10dc-7e35-469c-a33e-8304e1032802 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:36.217310 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 850/1685] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:23:36.221920 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df10dc-7e35-469c-a33e-8304e1032802 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:36.233416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df10dc-7e35-469c-a33e-8304e1032802 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:36.238801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f7a14-5d77-460b-9715-6fe88b98381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:36.240079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f7a14-5d77-460b-9715-6fe88b98381e admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:36.240430 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f7a14-5d77-460b-9715-6fe88b98381e admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:36.241079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f7a14-5d77-460b-9715-6fe88b98381e admin admin] PATH_INFO: `/v3/projects/084f73a72a51490d86eccf65e2360275/users/66f05f1a87cd449cb04c6aa091d75606/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:36.277857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058148da-41da-4ee6-9b14-ab681c21a2b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:36.278950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f7a14-5d77-460b-9715-6fe88b98381e admin admin] RBAC: Authorizing `identity:create_grant(project_id=084f73a72a51490d86eccf65e2360275, user_id=66f05f1a87cd449cb04c6aa091d75606, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:36.280009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058148da-41da-4ee6-9b14-ab681c21a2b1 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:36.281826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f7a14-5d77-460b-9715-6fe88b98381e admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:36.300049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 836/1686] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:36.314161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 851/1687] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:36 2022] PUT /identity/v3/projects/084f73a72a51490d86eccf65e2360275/users/66f05f1a87cd449cb04c6aa091d75606/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:23:36.315700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058148da-41da-4ee6-9b14-ab681c21a2b1 service nova] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:36.339249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058148da-41da-4ee6-9b14-ab681c21a2b1 service nova] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:36.448808 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37709741-0517-4479-aa6b-e1ec8664c394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:36.449450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37709741-0517-4479-aa6b-e1ec8664c394 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:36.449732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37709741-0517-4479-aa6b-e1ec8664c394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:36.450073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37709741-0517-4479-aa6b-e1ec8664c394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:36.450739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37709741-0517-4479-aa6b-e1ec8664c394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:36.452336 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37709741-0517-4479-aa6b-e1ec8664c394 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:36.489263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 837/1688] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:36.490746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f7a14-5d77-460b-9715-6fe88b98381e admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:36.509737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f7a14-5d77-460b-9715-6fe88b98381e admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:36.515936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5824a55-94e6-4451-8b13-b4a6c6ee81df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:36.517530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824a55-94e6-4451-8b13-b4a6c6ee81df admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:36.517869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824a55-94e6-4451-8b13-b4a6c6ee81df admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:36.518249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824a55-94e6-4451-8b13-b4a6c6ee81df admin admin] PATH_INFO: `/v3/projects/084f73a72a51490d86eccf65e2360275/users/66f05f1a87cd449cb04c6aa091d75606/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:36.535861 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5824a55-94e6-4451-8b13-b4a6c6ee81df admin admin] RBAC: Authorizing `identity:create_grant(project_id=084f73a72a51490d86eccf65e2360275, user_id=66f05f1a87cd449cb04c6aa091d75606, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:36.550259 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5824a55-94e6-4451-8b13-b4a6c6ee81df admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:36.583796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 852/1689] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:36 2022] PUT /identity/v3/projects/084f73a72a51490d86eccf65e2360275/users/66f05f1a87cd449cb04c6aa091d75606/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:36.595858 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa4cea-5e9b-4679-ac69-c5d1f0ca66df None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:36.596064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa4cea-5e9b-4679-ac69-c5d1f0ca66df None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:36.596226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa4cea-5e9b-4679-ac69-c5d1f0ca66df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:36.662301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-26fa4cea-5e9b-4679-ac69-c5d1f0ca66df None None] MFA Rules not processed for user `66f05f1a87cd449cb04c6aa091d75606`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:36.662301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-26fa4cea-5e9b-4679-ac69-c5d1f0ca66df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:36.830890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 838/1690] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:36.840800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5824a55-94e6-4451-8b13-b4a6c6ee81df admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:36.843284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-a5824a55-94e6-4451-8b13-b4a6c6ee81df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:36.937484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5824a55-94e6-4451-8b13-b4a6c6ee81df admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:36.943227 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f0711-7f89-4ab0-b3d5-f05f321d8df4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:36.944825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f0711-7f89-4ab0-b3d5-f05f321d8df4 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:36.945012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f0711-7f89-4ab0-b3d5-f05f321d8df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:36.945252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f0711-7f89-4ab0-b3d5-f05f321d8df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:36.957326 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f0711-7f89-4ab0-b3d5-f05f321d8df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:36.964695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f0711-7f89-4ab0-b3d5-f05f321d8df4 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:36.979602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 853/1691] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:37.166622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b90d2-707b-4e04-955d-6d502d3582a1 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:37.167242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b90d2-707b-4e04-955d-6d502d3582a1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:37.167496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b90d2-707b-4e04-955d-6d502d3582a1 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:37.169587 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 839/1692] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 2 08:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:23:37.175488 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ce761-9066-4c00-8514-dc6957c5516d None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:37.175874 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ce761-9066-4c00-8514-dc6957c5516d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:37.176269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ce761-9066-4c00-8514-dc6957c5516d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:37.251503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-f11ce761-9066-4c00-8514-dc6957c5516d None None] MFA Rules not processed for user `e68c134016414ea5b851bde233ed9951`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:37.254152 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f11ce761-9066-4c00-8514-dc6957c5516d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:37.331574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 854/1693] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:23:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:37.345543 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b90d2-707b-4e04-955d-6d502d3582a1 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:37.348590 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6f9b90d2-707b-4e04-955d-6d502d3582a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:37.373364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b90d2-707b-4e04-955d-6d502d3582a1 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:37.377457 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3247ce-a224-4026-ac04-9eb69b22929b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:37.378752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3247ce-a224-4026-ac04-9eb69b22929b service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:37.379101 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3247ce-a224-4026-ac04-9eb69b22929b service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:37.379447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3247ce-a224-4026-ac04-9eb69b22929b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:37.387145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:37.393454 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3247ce-a224-4026-ac04-9eb69b22929b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:37.396406 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3247ce-a224-4026-ac04-9eb69b22929b service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:37.409452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 840/1694] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:38.285830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ce761-9066-4c00-8514-dc6957c5516d None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:38.288863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f11ce761-9066-4c00-8514-dc6957c5516d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:38.349520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3247ce-a224-4026-ac04-9eb69b22929b service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:38.352255 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ea3247ce-a224-4026-ac04-9eb69b22929b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:38.383357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3247ce-a224-4026-ac04-9eb69b22929b service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:38.402836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c28cde-f375-4612-a2d8-8a83c2e25c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:38.403611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c28cde-f375-4612-a2d8-8a83c2e25c9c service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:38.403966 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c28cde-f375-4612-a2d8-8a83c2e25c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:38.404314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c28cde-f375-4612-a2d8-8a83c2e25c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:38.416111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:38.504061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ce761-9066-4c00-8514-dc6957c5516d None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:38.510453 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d15d21-8d64-4405-903c-8068aa738217 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3318842c46ec4c6d9b7b1f55c9fab62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:38.511910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d15d21-8d64-4405-903c-8068aa738217 service placement] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:38.515365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d15d21-8d64-4405-903c-8068aa738217 service placement] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:38.515552 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d15d21-8d64-4405-903c-8068aa738217 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:38.520990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-04d15d21-8d64-4405-903c-8068aa738217 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:38.554899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c28cde-f375-4612-a2d8-8a83c2e25c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:38.557160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c28cde-f375-4612-a2d8-8a83c2e25c9c service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:38.558224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d15d21-8d64-4405-903c-8068aa738217 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:38.559919 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d15d21-8d64-4405-903c-8068aa738217 service placement] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:38.591691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 855/1695] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:38.593242 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afd08a-8ae7-4e8a-bbc9-09d75358c21a None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:38.593563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afd08a-8ae7-4e8a-bbc9-09d75358c21a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:38.593931 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afd08a-8ae7-4e8a-bbc9-09d75358c21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:38.603755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 841/1696] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:23:38.618253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-32afd08a-8ae7-4e8a-bbc9-09d75358c21a None None] MFA Rules not processed for user `dc97bab8d9c943ee968db907513cc0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:38.619551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-32afd08a-8ae7-4e8a-bbc9-09d75358c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:38.682897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c28cde-f375-4612-a2d8-8a83c2e25c9c service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:38.686984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-82c28cde-f375-4612-a2d8-8a83c2e25c9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:38.750702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 856/1697] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:38.883206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c28cde-f375-4612-a2d8-8a83c2e25c9c service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:38.894059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:38.897111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:38.897613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:38.898071 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] PATH_INFO: `/v3/users/e9bd6a66cbc94a5686d96957a9724ff6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:38.902636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bd6a66cbc94a5686d96957a9724ff6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:38.907789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:39.030444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bd6a66cbc94a5686d96957a9724ff6'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:39.032693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bd6a66cbc94a5686d96957a9724ff6'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:39.049848 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bd6a66cbc94a5686d96957a9724ff6'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:39.084030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bd6a66cbc94a5686d96957a9724ff6'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:39.085022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bd6a66cbc94a5686d96957a9724ff6'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:39.121601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 842/1698] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:23:38 2022] DELETE /identity/v3/users/e9bd6a66cbc94a5686d96957a9724ff6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:40.324617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afd08a-8ae7-4e8a-bbc9-09d75358c21a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:40.341724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afd08a-8ae7-4e8a-bbc9-09d75358c21a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:40.536783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:40.542912 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:40.545794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:40.546148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] PATH_INFO: `/v3/projects/01e3882e516e4d2a99efe55af3942458` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:40.550147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e3882e516e4d2a99efe55af3942458)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:40.570413 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:40.719750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e3882e516e4d2a99efe55af3942458', 'request_id': 'req-abb29e36-be27-4968-9171-6f872d61f0b2'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:40.782643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e3882e516e4d2a99efe55af3942458', 'request_id': 'req-abb29e36-be27-4968-9171-6f872d61f0b2'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:40.809329 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e3882e516e4d2a99efe55af3942458', 'request_id': 'req-abb29e36-be27-4968-9171-6f872d61f0b2'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:40.832286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] The token cache is being invalidate because project 01e3882e516e4d2a99efe55af3942458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:23:40.832643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:40.833559 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:40.837601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 857/1699] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:23:40 2022] DELETE /identity/v3/projects/01e3882e516e4d2a99efe55af3942458 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:40.841571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:40.843920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:40.870248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d7016-2f99-46d9-af19-8440f7ba2f30 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:40.895651 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:41.033402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697e29d-a157-4471-91f0-81baa65c6917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:41.035952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697e29d-a157-4471-91f0-81baa65c6917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:41.036263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697e29d-a157-4471-91f0-81baa65c6917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:41.038125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697e29d-a157-4471-91f0-81baa65c6917 admin admin] PATH_INFO: `/v3/users/81600cb701eb4efcaaee3d533e5c9229` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:41.042646 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697e29d-a157-4471-91f0-81baa65c6917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81600cb701eb4efcaaee3d533e5c9229)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:41.050636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697e29d-a157-4471-91f0-81baa65c6917 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:41.151510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a697e29d-a157-4471-91f0-81baa65c6917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81600cb701eb4efcaaee3d533e5c9229'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:41.153053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a697e29d-a157-4471-91f0-81baa65c6917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81600cb701eb4efcaaee3d533e5c9229'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:41.170099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a697e29d-a157-4471-91f0-81baa65c6917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81600cb701eb4efcaaee3d533e5c9229'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:41.206985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a697e29d-a157-4471-91f0-81baa65c6917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81600cb701eb4efcaaee3d533e5c9229'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:41.210708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a697e29d-a157-4471-91f0-81baa65c6917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81600cb701eb4efcaaee3d533e5c9229'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:41.240286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 843/1700] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:23:40 2022] DELETE /identity/v3/users/81600cb701eb4efcaaee3d533e5c9229 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:23:42.010991 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:42.013472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:42.045563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb29e36-be27-4968-9171-6f872d61f0b2 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:42.057759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:42.172571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:42.177281 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:42.177815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:42.178728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] PATH_INFO: `/v3/projects/5b14a4fdad7446e5a65178a493462de1` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:42.181176 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b14a4fdad7446e5a65178a493462de1)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:42.189028 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:42.362748 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b14a4fdad7446e5a65178a493462de1', 'request_id': 'req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:42.381402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010581a-6c74-4bb9-a6db-bb2d2ad4786b None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:42.381402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010581a-6c74-4bb9-a6db-bb2d2ad4786b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:42.385088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010581a-6c74-4bb9-a6db-bb2d2ad4786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:42.387314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b14a4fdad7446e5a65178a493462de1', 'request_id': 'req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:42.399213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b14a4fdad7446e5a65178a493462de1', 'request_id': 'req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:42.459064 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] The token cache is being invalidate because project 5b14a4fdad7446e5a65178a493462de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:23:42.475249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:42.478257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-91bbf59d-65ef-46c5-ac0a-6c82704e69ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:42.492841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 858/1701] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:23:42 2022] DELETE /identity/v3/projects/5b14a4fdad7446e5a65178a493462de1 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:42.498188 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37012c40-44e7-4129-a492-fee554d017ae None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:42.498524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37012c40-44e7-4129-a492-fee554d017ae None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:42.501187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37012c40-44e7-4129-a492-fee554d017ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:42.601199 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-37012c40-44e7-4129-a492-fee554d017ae None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:42.611520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-37012c40-44e7-4129-a492-fee554d017ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:42.657312 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-0010581a-6c74-4bb9-a6db-bb2d2ad4786b None None] MFA Rules not processed for user `ad48c627d5d142489f40584eea36a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:42.659411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0010581a-6c74-4bb9-a6db-bb2d2ad4786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:42.932661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 859/1702] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:42.943551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774061fe-c924-471e-880e-143aa575a6d8 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:42.944034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774061fe-c924-471e-880e-143aa575a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:42.945005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774061fe-c924-471e-880e-143aa575a6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:43.023324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-774061fe-c924-471e-880e-143aa575a6d8 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:43.023324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-774061fe-c924-471e-880e-143aa575a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:43.037017 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 860/1703] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:23:43.041955 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774061fe-c924-471e-880e-143aa575a6d8 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:43.047860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 844/1704] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:23:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 669 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:23:43.069436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774061fe-c924-471e-880e-143aa575a6d8 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:43.083671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e111d91-185c-48f6-8b07-476c10f20803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:43.084306 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e111d91-185c-48f6-8b07-476c10f20803 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:43.085169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e111d91-185c-48f6-8b07-476c10f20803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:43.085468 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e111d91-185c-48f6-8b07-476c10f20803 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:43.086250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e111d91-185c-48f6-8b07-476c10f20803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:43.086549 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e111d91-185c-48f6-8b07-476c10f20803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:43.094934 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e111d91-185c-48f6-8b07-476c10f20803 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:43.133626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 861/1705] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:23:43.135192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010581a-6c74-4bb9-a6db-bb2d2ad4786b None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:43.142047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:43.151027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010581a-6c74-4bb9-a6db-bb2d2ad4786b None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:43.160526 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaa783-7822-47d5-99b1-7ef12f3fdbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:43.161206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa783-7822-47d5-99b1-7ef12f3fdbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:43.163888 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa783-7822-47d5-99b1-7ef12f3fdbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:43.164608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa783-7822-47d5-99b1-7ef12f3fdbf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:43.170857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafaa783-7822-47d5-99b1-7ef12f3fdbf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:43.173752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafaa783-7822-47d5-99b1-7ef12f3fdbf3 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:43.247185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 845/1706] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:43 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:23:43.254576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e111d91-185c-48f6-8b07-476c10f20803 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:43.276715 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e111d91-185c-48f6-8b07-476c10f20803 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:43.293323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:43.357403 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaa783-7822-47d5-99b1-7ef12f3fdbf3 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:43.359346 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-bafaa783-7822-47d5-99b1-7ef12f3fdbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:43.433640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595b78b-c0ee-4ec9-bb19-c1096fdea67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:43.434457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595b78b-c0ee-4ec9-bb19-c1096fdea67f admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:43.434837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595b78b-c0ee-4ec9-bb19-c1096fdea67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:43.435226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595b78b-c0ee-4ec9-bb19-c1096fdea67f admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:43.436005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595b78b-c0ee-4ec9-bb19-c1096fdea67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:43.440360 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595b78b-c0ee-4ec9-bb19-c1096fdea67f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:43.486865 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 862/1707] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:43 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:43.489278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595b78b-c0ee-4ec9-bb19-c1096fdea67f admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:43.532069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595b78b-c0ee-4ec9-bb19-c1096fdea67f admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:43.548152 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a17be-4683-4507-af47-1e5d996bebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:43.549233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a17be-4683-4507-af47-1e5d996bebaa admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:43.549577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a17be-4683-4507-af47-1e5d996bebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:43.549862 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a17be-4683-4507-af47-1e5d996bebaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:43.550622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a17be-4683-4507-af47-1e5d996bebaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:43.552240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a17be-4683-4507-af47-1e5d996bebaa admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:43.614033 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 863/1708] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:43.616609 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a17be-4683-4507-af47-1e5d996bebaa admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:43.634964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaa783-7822-47d5-99b1-7ef12f3fdbf3 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:43.643593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d99d1-72bb-4bb1-8b58-2689621caa57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02b653d2f5e4faca2906b2fbd1bfc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:43.644645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a17be-4683-4507-af47-1e5d996bebaa admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:43.645366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d99d1-72bb-4bb1-8b58-2689621caa57 service swift] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:43.645857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d99d1-72bb-4bb1-8b58-2689621caa57 service swift] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:43.646428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d99d1-72bb-4bb1-8b58-2689621caa57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:43.664732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbc586-34ea-4626-b341-9f76137a9989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:43.665381 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbc586-34ea-4626-b341-9f76137a9989 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:43.665661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbc586-34ea-4626-b341-9f76137a9989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:43.669920 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbc586-34ea-4626-b341-9f76137a9989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:43.670775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbc586-34ea-4626-b341-9f76137a9989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:43.672958 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbc586-34ea-4626-b341-9f76137a9989 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:43.700162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 864/1709] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:43.701555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbc586-34ea-4626-b341-9f76137a9989 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:43.725999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbc586-34ea-4626-b341-9f76137a9989 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:43.752669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145f11d-b152-40dc-8abd-e9767b51c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:43.753685 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145f11d-b152-40dc-8abd-e9767b51c077 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:43.753979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145f11d-b152-40dc-8abd-e9767b51c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:43.754944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145f11d-b152-40dc-8abd-e9767b51c077 admin admin] PATH_INFO: `/v3/projects/b91f0bf66d9f4fa7921be6fce4b9b93b/users/33ec18d6dce74895894a11ab0f480cd4/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:43.798545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145f11d-b152-40dc-8abd-e9767b51c077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91f0bf66d9f4fa7921be6fce4b9b93b, user_id=33ec18d6dce74895894a11ab0f480cd4, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:43.807862 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145f11d-b152-40dc-8abd-e9767b51c077 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:43.819741 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d99d1-72bb-4bb1-8b58-2689621caa57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:43.825553 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d99d1-72bb-4bb1-8b58-2689621caa57 service swift] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:43.839954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 865/1710] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:43 2022] PUT /identity/v3/projects/b91f0bf66d9f4fa7921be6fce4b9b93b/users/33ec18d6dce74895894a11ab0f480cd4/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:43.841804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedaae3-c1b2-4c95-8f40-6affe530b8f1 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:43.842137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedaae3-c1b2-4c95-8f40-6affe530b8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:43.842420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedaae3-c1b2-4c95-8f40-6affe530b8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:43.890429 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 846/1711] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 08:23:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:23:43.916219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-bbedaae3-c1b2-4c95-8f40-6affe530b8f1 None None] MFA Rules not processed for user `33ec18d6dce74895894a11ab0f480cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:43.917718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bbedaae3-c1b2-4c95-8f40-6affe530b8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:43.957281 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea9e5a-be40-473e-84fd-f191abf29e2d None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:43.959577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea9e5a-be40-473e-84fd-f191abf29e2d None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:43.960024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea9e5a-be40-473e-84fd-f191abf29e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:44.007623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-b8ea9e5a-be40-473e-84fd-f191abf29e2d None None] MFA Rules not processed for user `4a3a53f881ed4686a8dce1fb2b6df04d`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:44.010635 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b8ea9e5a-be40-473e-84fd-f191abf29e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:44.262117 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 847/1712] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:23:44.263399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 866/1713] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:23:44.269547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea9e5a-be40-473e-84fd-f191abf29e2d None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:44.290650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:44.299172 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedaae3-c1b2-4c95-8f40-6affe530b8f1 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:44.300856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bbedaae3-c1b2-4c95-8f40-6affe530b8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:44.555970 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea9e5a-be40-473e-84fd-f191abf29e2d None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:44.583527 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd157e2-74a6-4676-b7e3-5bd56e3e3624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:44.584198 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd157e2-74a6-4676-b7e3-5bd56e3e3624 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:44.584511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd157e2-74a6-4676-b7e3-5bd56e3e3624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:44.608142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd157e2-74a6-4676-b7e3-5bd56e3e3624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:44.608142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd157e2-74a6-4676-b7e3-5bd56e3e3624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:44.608142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd157e2-74a6-4676-b7e3-5bd56e3e3624 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:44.608517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:44.707186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedaae3-c1b2-4c95-8f40-6affe530b8f1 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:44.722222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98fdcb-8ce4-4831-9e00-6b88fc053c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:44.722902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98fdcb-8ce4-4831-9e00-6b88fc053c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:44.726695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98fdcb-8ce4-4831-9e00-6b88fc053c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:44.727083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98fdcb-8ce4-4831-9e00-6b88fc053c4e admin admin] PATH_INFO: `/v3/users/d3add387f18e4719b5cc91aaf09921ae` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:44.732745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98fdcb-8ce4-4831-9e00-6b88fc053c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3add387f18e4719b5cc91aaf09921ae)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:44.738858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98fdcb-8ce4-4831-9e00-6b88fc053c4e admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:44.750464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 848/1714] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:44 2022] POST /identity/v3/projects => generated 373 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:44.754619 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd157e2-74a6-4676-b7e3-5bd56e3e3624 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:44.916798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ea98fdcb-8ce4-4831-9e00-6b88fc053c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3add387f18e4719b5cc91aaf09921ae'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:44.939788 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd157e2-74a6-4676-b7e3-5bd56e3e3624 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:44.949130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ea98fdcb-8ce4-4831-9e00-6b88fc053c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3add387f18e4719b5cc91aaf09921ae'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:44.960343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c93181-6077-4188-8c6a-287eb73e0bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:44.965523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c93181-6077-4188-8c6a-287eb73e0bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:44.966606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c93181-6077-4188-8c6a-287eb73e0bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:44.967521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c93181-6077-4188-8c6a-287eb73e0bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:44.970359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c93181-6077-4188-8c6a-287eb73e0bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:44.972465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ea98fdcb-8ce4-4831-9e00-6b88fc053c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3add387f18e4719b5cc91aaf09921ae'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:44.973359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ea98fdcb-8ce4-4831-9e00-6b88fc053c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3add387f18e4719b5cc91aaf09921ae'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:44.977609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c93181-6077-4188-8c6a-287eb73e0bd6 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:45.034583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ea98fdcb-8ce4-4831-9e00-6b88fc053c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3add387f18e4719b5cc91aaf09921ae'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:45.054535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 849/1715] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:44 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:45.058662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c93181-6077-4188-8c6a-287eb73e0bd6 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:45.065856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 867/1716] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:23:44 2022] DELETE /identity/v3/users/d3add387f18e4719b5cc91aaf09921ae => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:23:45.070780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4192c3-1716-4c64-ade8-66513abfdddc None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:45.071077 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4192c3-1716-4c64-ade8-66513abfdddc None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:45.071394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4192c3-1716-4c64-ade8-66513abfdddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:45.072914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-97c93181-6077-4188-8c6a-287eb73e0bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:45.144327 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-0c4192c3-1716-4c64-ade8-66513abfdddc None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:45.145565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-0c4192c3-1716-4c64-ade8-66513abfdddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:45.165545 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c93181-6077-4188-8c6a-287eb73e0bd6 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:45.317950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 868/1717] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:45.346990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e6730-1d3f-4da1-a09d-11881dde5ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:45.347603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e6730-1d3f-4da1-a09d-11881dde5ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:45.347881 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e6730-1d3f-4da1-a09d-11881dde5ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:45.348210 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e6730-1d3f-4da1-a09d-11881dde5ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:45.350135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e6730-1d3f-4da1-a09d-11881dde5ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:45.356213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e6730-1d3f-4da1-a09d-11881dde5ab7 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:45.380082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4192c3-1716-4c64-ade8-66513abfdddc None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:45.382575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-0c4192c3-1716-4c64-ade8-66513abfdddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:45.406443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 850/1718] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:45.412590 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e6730-1d3f-4da1-a09d-11881dde5ab7 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:45.432740 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e6730-1d3f-4da1-a09d-11881dde5ab7 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:45.448352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed86b5-048e-476e-be96-8aeb2368a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:45.449973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed86b5-048e-476e-be96-8aeb2368a6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:45.455405 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed86b5-048e-476e-be96-8aeb2368a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:45.455964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed86b5-048e-476e-be96-8aeb2368a6d7 admin admin] PATH_INFO: `/v3/projects/f29de4c1bb8b43af9bacf3117be88d04/users/28162e835dd94e29995e25f568327d87/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:45.495875 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed86b5-048e-476e-be96-8aeb2368a6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29de4c1bb8b43af9bacf3117be88d04, user_id=28162e835dd94e29995e25f568327d87, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:45.498877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed86b5-048e-476e-be96-8aeb2368a6d7 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:45.504023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:45.539091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 851/1719] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:45 2022] PUT /identity/v3/projects/f29de4c1bb8b43af9bacf3117be88d04/users/28162e835dd94e29995e25f568327d87/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:45.541268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed86b5-048e-476e-be96-8aeb2368a6d7 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:45.564080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4192c3-1716-4c64-ade8-66513abfdddc None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:45.660004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:45.770702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afebac-a32c-4be5-b559-6ba479c628e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:45.773367 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afebac-a32c-4be5-b559-6ba479c628e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:45.773710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afebac-a32c-4be5-b559-6ba479c628e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:45.774433 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afebac-a32c-4be5-b559-6ba479c628e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:45.777422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed86b5-048e-476e-be96-8aeb2368a6d7 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:45.790967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cc8b9-f73b-4c9b-b16e-23c93f491e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:45.792067 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cc8b9-f73b-4c9b-b16e-23c93f491e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:45.793489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cc8b9-f73b-4c9b-b16e-23c93f491e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:45.793792 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cc8b9-f73b-4c9b-b16e-23c93f491e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:45.795570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cc8b9-f73b-4c9b-b16e-23c93f491e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:45.799943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afebac-a32c-4be5-b559-6ba479c628e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:45.801035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cc8b9-f73b-4c9b-b16e-23c93f491e28 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:45.803891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afebac-a32c-4be5-b559-6ba479c628e4 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:45.840120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 852/1720] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:45.841776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cc8b9-f73b-4c9b-b16e-23c93f491e28 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:45.843414 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 869/1721] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:23:45.857970 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cc8b9-f73b-4c9b-b16e-23c93f491e28 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:45.864784 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5fb74-99b4-4580-ab7d-5904ed5c79f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:45.866523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5fb74-99b4-4580-ab7d-5904ed5c79f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:45.866827 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5fb74-99b4-4580-ab7d-5904ed5c79f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:45.867348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5fb74-99b4-4580-ab7d-5904ed5c79f1 admin admin] PATH_INFO: `/v3/projects/f29de4c1bb8b43af9bacf3117be88d04/users/28162e835dd94e29995e25f568327d87/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:45.871475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5fb74-99b4-4580-ab7d-5904ed5c79f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29de4c1bb8b43af9bacf3117be88d04, user_id=28162e835dd94e29995e25f568327d87, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:45.876210 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5fb74-99b4-4580-ab7d-5904ed5c79f1 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:45.911210 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3829-fe14-4aaf-b60c-62aca8465a8c None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:45.911720 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3829-fe14-4aaf-b60c-62aca8465a8c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:45.912069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3829-fe14-4aaf-b60c-62aca8465a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:45.916359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 853/1722] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:45 2022] PUT /identity/v3/projects/f29de4c1bb8b43af9bacf3117be88d04/users/28162e835dd94e29995e25f568327d87/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:45.974808 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-b66d3829-fe14-4aaf-b60c-62aca8465a8c None None] MFA Rules not processed for user `28162e835dd94e29995e25f568327d87`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:45.976807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b66d3829-fe14-4aaf-b60c-62aca8465a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:46.189811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 870/1723] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:46.202387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5fb74-99b4-4580-ab7d-5904ed5c79f1 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:46.207080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c0e5fb74-99b4-4580-ab7d-5904ed5c79f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:46.399808 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5fb74-99b4-4580-ab7d-5904ed5c79f1 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:46.431360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa329952-7d37-4216-b051-10696d81dc38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:46.432714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa329952-7d37-4216-b051-10696d81dc38 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:46.433015 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa329952-7d37-4216-b051-10696d81dc38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:46.434268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa329952-7d37-4216-b051-10696d81dc38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:46.471175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa329952-7d37-4216-b051-10696d81dc38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:46.480179 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa329952-7d37-4216-b051-10696d81dc38 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:46.514844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688340e0-dd47-4f72-b8de-2cf8e3559fe6 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:46.515434 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688340e0-dd47-4f72-b8de-2cf8e3559fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:46.515434 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688340e0-dd47-4f72-b8de-2cf8e3559fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:46.539694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 854/1724] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:46.576288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-688340e0-dd47-4f72-b8de-2cf8e3559fe6 None None] MFA Rules not processed for user `e68c134016414ea5b851bde233ed9951`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:46.580753 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-688340e0-dd47-4f72-b8de-2cf8e3559fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:46.844668 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa329952-7d37-4216-b051-10696d81dc38 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:46.851963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 871/1725] 10.222.0.66 () {58 vars in 1015 bytes} [Tue Aug 2 08:23:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:46.852568 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-aa329952-7d37-4216-b051-10696d81dc38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:46.910003 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688340e0-dd47-4f72-b8de-2cf8e3559fe6 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:46.911814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-688340e0-dd47-4f72-b8de-2cf8e3559fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:46.939263 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688340e0-dd47-4f72-b8de-2cf8e3559fe6 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:46.941404 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa329952-7d37-4216-b051-10696d81dc38 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:46.958975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25688438-a33a-41f7-ad46-d027f20c037a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:46.960023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf534a-b3ca-491b-be0c-e09c58667300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:46.963169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25688438-a33a-41f7-ad46-d027f20c037a service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:46.963801 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf534a-b3ca-491b-be0c-e09c58667300 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:46.966420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf534a-b3ca-491b-be0c-e09c58667300 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:46.966669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25688438-a33a-41f7-ad46-d027f20c037a service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:46.966989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25688438-a33a-41f7-ad46-d027f20c037a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:46.968191 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf534a-b3ca-491b-be0c-e09c58667300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:46.980244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0eaf534a-b3ca-491b-be0c-e09c58667300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:47.009366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25688438-a33a-41f7-ad46-d027f20c037a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:47.011052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25688438-a33a-41f7-ad46-d027f20c037a service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:47.061725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 872/1726] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:47.245134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf534a-b3ca-491b-be0c-e09c58667300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:47.248825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf534a-b3ca-491b-be0c-e09c58667300 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:47.312991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 855/1727] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:47.449370 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25688438-a33a-41f7-ad46-d027f20c037a service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:47.465567 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25688438-a33a-41f7-ad46-d027f20c037a service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:47.475555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de1992-d40d-4a85-907d-cdcd9e306f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:47.478556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de1992-d40d-4a85-907d-cdcd9e306f98 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:47.479136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de1992-d40d-4a85-907d-cdcd9e306f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:47.480620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de1992-d40d-4a85-907d-cdcd9e306f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:47.486830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-54de1992-d40d-4a85-907d-cdcd9e306f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:47.669170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:47.731258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de1992-d40d-4a85-907d-cdcd9e306f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:47.734041 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de1992-d40d-4a85-907d-cdcd9e306f98 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:47.773525 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 873/1728] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:49.384015 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf534a-b3ca-491b-be0c-e09c58667300 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:49.386600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0eaf534a-b3ca-491b-be0c-e09c58667300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:49.471258 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:49.695880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de1992-d40d-4a85-907d-cdcd9e306f98 service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:49.697352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-54de1992-d40d-4a85-907d-cdcd9e306f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:49.697685 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf534a-b3ca-491b-be0c-e09c58667300 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:49.724410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:49.728157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:49.729628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:49.730852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] PATH_INFO: `/v3/projects/811410ad686747979d35dff7db1ca1eb` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:49.734383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=811410ad686747979d35dff7db1ca1eb)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:49.739415 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:49.746558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de1992-d40d-4a85-907d-cdcd9e306f98 service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:49.758723 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6d08b-5b77-4aa8-87df-2586edaf1d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:49.759671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6d08b-5b77-4aa8-87df-2586edaf1d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:49.760083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6d08b-5b77-4aa8-87df-2586edaf1d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:49.760482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6d08b-5b77-4aa8-87df-2586edaf1d4d admin admin] PATH_INFO: `/v3/users/d7f55854f32d47988d0ca6d4641c5649` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:49.763108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6d08b-5b77-4aa8-87df-2586edaf1d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7f55854f32d47988d0ca6d4641c5649)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:49.768811 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6d08b-5b77-4aa8-87df-2586edaf1d4d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:49.910101 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811410ad686747979d35dff7db1ca1eb', 'request_id': 'req-0629fefc-250c-4f58-884e-6038d93b1a1a'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:49.937644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811410ad686747979d35dff7db1ca1eb', 'request_id': 'req-0629fefc-250c-4f58-884e-6038d93b1a1a'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:49.939354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-00a6d08b-5b77-4aa8-87df-2586edaf1d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7f55854f32d47988d0ca6d4641c5649'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:49.950878 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-00a6d08b-5b77-4aa8-87df-2586edaf1d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7f55854f32d47988d0ca6d4641c5649'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:49.969305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811410ad686747979d35dff7db1ca1eb', 'request_id': 'req-0629fefc-250c-4f58-884e-6038d93b1a1a'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:49.972575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-00a6d08b-5b77-4aa8-87df-2586edaf1d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7f55854f32d47988d0ca6d4641c5649'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:49.973483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-00a6d08b-5b77-4aa8-87df-2586edaf1d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7f55854f32d47988d0ca6d4641c5649'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:50.039510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] The token cache is being invalidate because project 811410ad686747979d35dff7db1ca1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:23:50.039719 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:50.043356 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0629fefc-250c-4f58-884e-6038d93b1a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:50.047535 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-00a6d08b-5b77-4aa8-87df-2586edaf1d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7f55854f32d47988d0ca6d4641c5649'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:50.055928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 856/1729] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:23:49 2022] DELETE /identity/v3/projects/811410ad686747979d35dff7db1ca1eb => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:50.057774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24006-b39a-4747-8967-2c733cbfe9e4 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:50.058112 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24006-b39a-4747-8967-2c733cbfe9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:50.062456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd24006-b39a-4747-8967-2c733cbfe9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:50.091412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 874/1730] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:23:49 2022] DELETE /identity/v3/users/d7f55854f32d47988d0ca6d4641c5649 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:23:50.094638 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ce104-b292-48e0-a5bd-53b1d3631404 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:50.094870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ce104-b292-48e0-a5bd-53b1d3631404 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:50.095153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ce104-b292-48e0-a5bd-53b1d3631404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:50.180746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-9fd24006-b39a-4747-8967-2c733cbfe9e4 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:50.181810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d65ce104-b292-48e0-a5bd-53b1d3631404 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:50.185948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d65ce104-b292-48e0-a5bd-53b1d3631404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:50.188390 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9fd24006-b39a-4747-8967-2c733cbfe9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:50.430904 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 857/1731] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:50.437165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 875/1732] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:50.438764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a4cfe-658a-4baa-b4cb-b375e82a8d47 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:50.439052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a4cfe-658a-4baa-b4cb-b375e82a8d47 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:50.439330 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a4cfe-658a-4baa-b4cb-b375e82a8d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:50.484311 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-a46a4cfe-658a-4baa-b4cb-b375e82a8d47 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:50.486143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-a46a4cfe-658a-4baa-b4cb-b375e82a8d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:50.514252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ce104-b292-48e0-a5bd-53b1d3631404 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:50.520779 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 858/1733] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:50.532877 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ce104-b292-48e0-a5bd-53b1d3631404 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:50.550223 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23bf3b-f9a1-441b-b5db-4d43b24a627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:50.550869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23bf3b-f9a1-441b-b5db-4d43b24a627b admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:50.551146 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23bf3b-f9a1-441b-b5db-4d43b24a627b admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:50.551420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23bf3b-f9a1-441b-b5db-4d43b24a627b admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:50.552129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23bf3b-f9a1-441b-b5db-4d43b24a627b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:50.552434 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23bf3b-f9a1-441b-b5db-4d43b24a627b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:50.559789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23bf3b-f9a1-441b-b5db-4d43b24a627b admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:50.608069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c74c6b-c1bc-44c9-840f-8b734328d63b None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:50.608400 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c74c6b-c1bc-44c9-840f-8b734328d63b None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:50.608631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c74c6b-c1bc-44c9-840f-8b734328d63b None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:50.610354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 859/1734] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 08:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:23:50.615211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c74c6b-c1bc-44c9-840f-8b734328d63b None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:50.616764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 876/1735] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:23:50.640970 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c74c6b-c1bc-44c9-840f-8b734328d63b None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:50.653906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafb8cd-8286-4c67-9b7c-a3303946c8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:50.654577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafb8cd-8286-4c67-9b7c-a3303946c8bc admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:50.655154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafb8cd-8286-4c67-9b7c-a3303946c8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:50.655434 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbafb8cd-8286-4c67-9b7c-a3303946c8bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:50.656116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafb8cd-8286-4c67-9b7c-a3303946c8bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:50.670837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbafb8cd-8286-4c67-9b7c-a3303946c8bc admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:50.743618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23bf3b-f9a1-441b-b5db-4d43b24a627b admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:50.745730 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-de23bf3b-f9a1-441b-b5db-4d43b24a627b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:50.778265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 860/1736] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:50 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:50.779781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafb8cd-8286-4c67-9b7c-a3303946c8bc admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:50.876090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:50.939605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:50.946621 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23bf3b-f9a1-441b-b5db-4d43b24a627b admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:50.960756 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbafb8cd-8286-4c67-9b7c-a3303946c8bc admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:50.968020 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15891792-86e6-47b6-a211-39b4f3d67777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:50.969219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891792-86e6-47b6-a211-39b4f3d67777 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:50.969767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891792-86e6-47b6-a211-39b4f3d67777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:50.970374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891792-86e6-47b6-a211-39b4f3d67777 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:50.971713 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15891792-86e6-47b6-a211-39b4f3d67777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:50.974587 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15891792-86e6-47b6-a211-39b4f3d67777 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:51.053164 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 861/1737] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:50 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:51.055504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4388-cdfa-4e34-b8db-c596b15b4f2e None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:51.056061 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4388-cdfa-4e34-b8db-c596b15b4f2e None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:51.056517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b4388-cdfa-4e34-b8db-c596b15b4f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:51.081981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-405b4388-cdfa-4e34-b8db-c596b15b4f2e None None] MFA Rules not processed for user `93143507a8784a30bc6b4a5e1f24f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:51.083753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-405b4388-cdfa-4e34-b8db-c596b15b4f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:51.133091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925cb6e-13bc-4892-bc9a-3fe92a8a4d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:51.133770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925cb6e-13bc-4892-bc9a-3fe92a8a4d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:51.134113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925cb6e-13bc-4892-bc9a-3fe92a8a4d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:51.134357 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925cb6e-13bc-4892-bc9a-3fe92a8a4d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:51.175782 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925cb6e-13bc-4892-bc9a-3fe92a8a4d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:51.177242 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925cb6e-13bc-4892-bc9a-3fe92a8a4d9c service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:51.202538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 877/1738] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:23:51.203614 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a0c1-0d19-4e60-9a1e-0506e4aeb20d None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:51.203900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a0c1-0d19-4e60-9a1e-0506e4aeb20d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:51.204173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a0c1-0d19-4e60-9a1e-0506e4aeb20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:51.210688 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 862/1739] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 08:23:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:51.211856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b4388-cdfa-4e34-b8db-c596b15b4f2e None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:51.236064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b4388-cdfa-4e34-b8db-c596b15b4f2e None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:51.258847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1353f28-245f-47b9-bc42-1c6edca1184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:51.262435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1353f28-245f-47b9-bc42-1c6edca1184b admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:51.263785 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1353f28-245f-47b9-bc42-1c6edca1184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:51.267329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1353f28-245f-47b9-bc42-1c6edca1184b admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:51.268583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1353f28-245f-47b9-bc42-1c6edca1184b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:51.269848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-27d7a0c1-0d19-4e60-9a1e-0506e4aeb20d None None] MFA Rules not processed for user `2ce8f85c676447d5b15770c4c64d4237`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:51.275733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-27d7a0c1-0d19-4e60-9a1e-0506e4aeb20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:51.286876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1353f28-245f-47b9-bc42-1c6edca1184b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:51.330180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 863/1740] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:51.331105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1353f28-245f-47b9-bc42-1c6edca1184b admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:51.336713 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c1353f28-245f-47b9-bc42-1c6edca1184b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:51.380058 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1353f28-245f-47b9-bc42-1c6edca1184b admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:51.406057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddab88-2625-4991-88b7-d890e87f7219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:51.406715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddab88-2625-4991-88b7-d890e87f7219 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:51.408675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddab88-2625-4991-88b7-d890e87f7219 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:51.408984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddab88-2625-4991-88b7-d890e87f7219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:51.441285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddab88-2625-4991-88b7-d890e87f7219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:51.443078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddab88-2625-4991-88b7-d890e87f7219 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:51.471593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 864/1741] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:51.472549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddab88-2625-4991-88b7-d890e87f7219 service nova] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:51.525243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddab88-2625-4991-88b7-d890e87f7219 service nova] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:51.536767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40837c95-aa0c-402b-b7d6-3479b0b0b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:51.537681 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40837c95-aa0c-402b-b7d6-3479b0b0b42f admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:51.538817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40837c95-aa0c-402b-b7d6-3479b0b0b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:51.539877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40837c95-aa0c-402b-b7d6-3479b0b0b42f admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:51.540773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40837c95-aa0c-402b-b7d6-3479b0b0b42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:51.544474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40837c95-aa0c-402b-b7d6-3479b0b0b42f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:51.559546 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 878/1742] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:51.561163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f57b-ba55-4126-8cac-f790e1a4b497 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:51.561459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f57b-ba55-4126-8cac-f790e1a4b497 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:51.561736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6f57b-ba55-4126-8cac-f790e1a4b497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:51.570413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 865/1743] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:51.571843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40837c95-aa0c-402b-b7d6-3479b0b0b42f admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:51.612220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40837c95-aa0c-402b-b7d6-3479b0b0b42f admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:51.636759 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce05469-af27-491f-889d-0d8dc75bfbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:51.637543 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce05469-af27-491f-889d-0d8dc75bfbe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:51.637842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce05469-af27-491f-889d-0d8dc75bfbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:51.642262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce05469-af27-491f-889d-0d8dc75bfbe7 admin admin] PATH_INFO: `/v3/projects/d732c3902e614240a679103202da89fd/users/1de8f15bdb234fb194c52d969d60fdef/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:51.652676 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d1e6f57b-ba55-4126-8cac-f790e1a4b497 None None] MFA Rules not processed for user `2ce8f85c676447d5b15770c4c64d4237`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:51.666473 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d1e6f57b-ba55-4126-8cac-f790e1a4b497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:51.695344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce05469-af27-491f-889d-0d8dc75bfbe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d732c3902e614240a679103202da89fd, user_id=1de8f15bdb234fb194c52d969d60fdef, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:51.698523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce05469-af27-491f-889d-0d8dc75bfbe7 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:51.703359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 879/1744] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:51.712046 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6f57b-ba55-4126-8cac-f790e1a4b497 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:51.719116 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d1e6f57b-ba55-4126-8cac-f790e1a4b497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:51.747003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 866/1745] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:51 2022] PUT /identity/v3/projects/d732c3902e614240a679103202da89fd/users/1de8f15bdb234fb194c52d969d60fdef/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:51.762559 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5f621-0eb1-45ca-92ee-5e6e8acf36be None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:51.762884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5f621-0eb1-45ca-92ee-5e6e8acf36be None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:51.763231 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5f621-0eb1-45ca-92ee-5e6e8acf36be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:51.788451 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6f57b-ba55-4126-8cac-f790e1a4b497 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:51.851138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-d2c5f621-0eb1-45ca-92ee-5e6e8acf36be None None] MFA Rules not processed for user `1de8f15bdb234fb194c52d969d60fdef`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:51.855693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d2c5f621-0eb1-45ca-92ee-5e6e8acf36be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:51.976460 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:52.030155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58407180-14e6-4b6f-b1fc-83050de3fd63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:52.031541 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58407180-14e6-4b6f-b1fc-83050de3fd63 service nova] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:52.031830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58407180-14e6-4b6f-b1fc-83050de3fd63 service nova] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:52.032110 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58407180-14e6-4b6f-b1fc-83050de3fd63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:52.114673 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:52.152017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 867/1746] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:23:52.153475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fa1b7-1e29-4abf-952b-ff13d62639ff None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:52.153812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fa1b7-1e29-4abf-952b-ff13d62639ff None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:52.154181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fa1b7-1e29-4abf-952b-ff13d62639ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:52.190453 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58407180-14e6-4b6f-b1fc-83050de3fd63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:52.192708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58407180-14e6-4b6f-b1fc-83050de3fd63 service nova] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:52.229409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-ea8fa1b7-1e29-4abf-952b-ff13d62639ff None None] MFA Rules not processed for user `7d9879cce3dc43178f196dbe9294c8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:52.230922 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ea8fa1b7-1e29-4abf-952b-ff13d62639ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:52.239966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 880/1747] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:52.239966 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58407180-14e6-4b6f-b1fc-83050de3fd63 service nova] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:52.436035 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58407180-14e6-4b6f-b1fc-83050de3fd63 service nova] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:52.459441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532c51a-5a71-46da-9d25-cc28fd76e399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:52.459686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c51a-5a71-46da-9d25-cc28fd76e399 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:52.459957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c51a-5a71-46da-9d25-cc28fd76e399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:52.460234 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532c51a-5a71-46da-9d25-cc28fd76e399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:52.461665 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532c51a-5a71-46da-9d25-cc28fd76e399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:52.471104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532c51a-5a71-46da-9d25-cc28fd76e399 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:52.487338 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 868/1748] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:52.510896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fa1b7-1e29-4abf-952b-ff13d62639ff None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:52.541090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fa1b7-1e29-4abf-952b-ff13d62639ff None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:52.547826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3db9f0-d1ce-4caa-a08c-a0336acf09a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:52.548884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3db9f0-d1ce-4caa-a08c-a0336acf09a6 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:52.549122 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3db9f0-d1ce-4caa-a08c-a0336acf09a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:52.554871 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3db9f0-d1ce-4caa-a08c-a0336acf09a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:52.566690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 881/1749] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:52 2022] POST /identity/v3/projects => generated 365 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:52.572213 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532c51a-5a71-46da-9d25-cc28fd76e399 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:52.596893 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3db9f0-d1ce-4caa-a08c-a0336acf09a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:52.600438 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3db9f0-d1ce-4caa-a08c-a0336acf09a6 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:52.623281 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 869/1750] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:23:52.718052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532c51a-5a71-46da-9d25-cc28fd76e399 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:52.744375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464287fd-fe54-482e-8ff3-188c84f1cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:52.745165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464287fd-fe54-482e-8ff3-188c84f1cc54 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:52.746711 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464287fd-fe54-482e-8ff3-188c84f1cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:52.748776 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464287fd-fe54-482e-8ff3-188c84f1cc54 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:52.748907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464287fd-fe54-482e-8ff3-188c84f1cc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:52.753346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464287fd-fe54-482e-8ff3-188c84f1cc54 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:52.775643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3db9f0-d1ce-4caa-a08c-a0336acf09a6 service nova] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:52.778442 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0a3db9f0-d1ce-4caa-a08c-a0336acf09a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:52.799675 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 882/1751] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:52 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:23:52.803805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464287fd-fe54-482e-8ff3-188c84f1cc54 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:52.823570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3db9f0-d1ce-4caa-a08c-a0336acf09a6 service nova] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:52.832112 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464287fd-fe54-482e-8ff3-188c84f1cc54 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:52.838028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49b40b-cb24-462e-bd80-0e96c836a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:52.841132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49b40b-cb24-462e-bd80-0e96c836a73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:52.843046 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49b40b-cb24-462e-bd80-0e96c836a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:52.843178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f2ef4-c842-4a78-9926-320b46b169db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:52.844470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49b40b-cb24-462e-bd80-0e96c836a73a admin admin] PATH_INFO: `/v3/users/edee704975674af798702284cdd68e56` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:52.845756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f2ef4-c842-4a78-9926-320b46b169db admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:52.847606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f2ef4-c842-4a78-9926-320b46b169db admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:52.848064 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f2ef4-c842-4a78-9926-320b46b169db admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:52.849814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f2ef4-c842-4a78-9926-320b46b169db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:52.851684 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49b40b-cb24-462e-bd80-0e96c836a73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=edee704975674af798702284cdd68e56)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:52.855662 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f2ef4-c842-4a78-9926-320b46b169db admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:52.862335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49b40b-cb24-462e-bd80-0e96c836a73a admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:52.883718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 883/1752] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:52.887271 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f2ef4-c842-4a78-9926-320b46b169db admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:52.929382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f2ef4-c842-4a78-9926-320b46b169db admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:52.957721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec7b3d-0e33-49f1-957e-73b5796c4369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:52.959789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec7b3d-0e33-49f1-957e-73b5796c4369 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:52.961126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec7b3d-0e33-49f1-957e-73b5796c4369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:52.961426 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec7b3d-0e33-49f1-957e-73b5796c4369 admin admin] PATH_INFO: `/v3/projects/2fcce107aaf94ac79a8588ca4a15c43d/users/b7b437b0ae7f482bae87c56d6d1b4649/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:53.016252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec7b3d-0e33-49f1-957e-73b5796c4369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcce107aaf94ac79a8588ca4a15c43d, user_id=b7b437b0ae7f482bae87c56d6d1b4649, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:53.016899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7f49b40b-cb24-462e-bd80-0e96c836a73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edee704975674af798702284cdd68e56'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:53.018374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7f49b40b-cb24-462e-bd80-0e96c836a73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edee704975674af798702284cdd68e56'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:53.024300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec7b3d-0e33-49f1-957e-73b5796c4369 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:53.039713 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7f49b40b-cb24-462e-bd80-0e96c836a73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edee704975674af798702284cdd68e56'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:53.065497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7f49b40b-cb24-462e-bd80-0e96c836a73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edee704975674af798702284cdd68e56'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:53.067845 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7f49b40b-cb24-462e-bd80-0e96c836a73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edee704975674af798702284cdd68e56'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:53.074168 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 884/1753] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:52 2022] PUT /identity/v3/projects/2fcce107aaf94ac79a8588ca4a15c43d/users/b7b437b0ae7f482bae87c56d6d1b4649/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:53.078392 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec7b3d-0e33-49f1-957e-73b5796c4369 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:53.080659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-86ec7b3d-0e33-49f1-957e-73b5796c4369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:53.107405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:53.111322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 870/1754] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:23:52 2022] DELETE /identity/v3/users/edee704975674af798702284cdd68e56 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:53.117593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c414a08-a957-4eaa-a774-f179e4a04c81 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:53.126482 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c414a08-a957-4eaa-a774-f179e4a04c81 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:53.126482 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c414a08-a957-4eaa-a774-f179e4a04c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:53.172213 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-5c414a08-a957-4eaa-a774-f179e4a04c81 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:53.183798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-5c414a08-a957-4eaa-a774-f179e4a04c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:53.222793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:53.291810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec7b3d-0e33-49f1-957e-73b5796c4369 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:53.350043 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 871/1755] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:53.398176 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c414a08-a957-4eaa-a774-f179e4a04c81 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:53.399909 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-5c414a08-a957-4eaa-a774-f179e4a04c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:53.422677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cfac8-f383-4d6f-86e1-c776b9bd2041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:53.423335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cfac8-f383-4d6f-86e1-c776b9bd2041 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:53.423620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cfac8-f383-4d6f-86e1-c776b9bd2041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:53.423906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cfac8-f383-4d6f-86e1-c776b9bd2041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:53.424710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cfac8-f383-4d6f-86e1-c776b9bd2041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:53.426511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cfac8-f383-4d6f-86e1-c776b9bd2041 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:53.455764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 885/1756] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:23:53.460808 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cfac8-f383-4d6f-86e1-c776b9bd2041 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:53.478508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cfac8-f383-4d6f-86e1-c776b9bd2041 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:53.493043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c2872-ae3f-4b54-9086-d9cf8bcfcd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:53.493755 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2872-ae3f-4b54-9086-d9cf8bcfcd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:53.494059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2872-ae3f-4b54-9086-d9cf8bcfcd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:53.494344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c2872-ae3f-4b54-9086-d9cf8bcfcd5b admin admin] PATH_INFO: `/v3/projects/2fcce107aaf94ac79a8588ca4a15c43d/users/b7b437b0ae7f482bae87c56d6d1b4649/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:53.500926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c2872-ae3f-4b54-9086-d9cf8bcfcd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcce107aaf94ac79a8588ca4a15c43d, user_id=b7b437b0ae7f482bae87c56d6d1b4649, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:53.503261 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c2872-ae3f-4b54-9086-d9cf8bcfcd5b admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:53.504069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c414a08-a957-4eaa-a774-f179e4a04c81 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:53.516047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c62d1f-f180-4dca-a866-7d41eea1877a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:53.517348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62d1f-f180-4dca-a866-7d41eea1877a service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:53.518265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62d1f-f180-4dca-a866-7d41eea1877a service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:53.521226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c62d1f-f180-4dca-a866-7d41eea1877a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:53.532332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 886/1757] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:53 2022] PUT /identity/v3/projects/2fcce107aaf94ac79a8588ca4a15c43d/users/b7b437b0ae7f482bae87c56d6d1b4649/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:53.543216 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609254-70c7-42bf-8ffc-dd69780aaac0 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:53.543502 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609254-70c7-42bf-8ffc-dd69780aaac0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:53.543785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af609254-70c7-42bf-8ffc-dd69780aaac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:53.546042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c62d1f-f180-4dca-a866-7d41eea1877a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:53.548031 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c62d1f-f180-4dca-a866-7d41eea1877a service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:53.560902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 872/1758] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:23:53.599111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-af609254-70c7-42bf-8ffc-dd69780aaac0 None None] MFA Rules not processed for user `b7b437b0ae7f482bae87c56d6d1b4649`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:53.600937 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-af609254-70c7-42bf-8ffc-dd69780aaac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:53.771507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 887/1759] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:23:53.788502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c62d1f-f180-4dca-a866-7d41eea1877a service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:53.791671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-42c62d1f-f180-4dca-a866-7d41eea1877a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:53.949091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c62d1f-f180-4dca-a866-7d41eea1877a service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:54.078032 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9b5b7-688e-40cf-a3b4-480d1afac349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:54.081040 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b5b7-688e-40cf-a3b4-480d1afac349 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:54.081330 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b5b7-688e-40cf-a3b4-480d1afac349 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:54.081614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b5b7-688e-40cf-a3b4-480d1afac349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:54.108038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b5b7-688e-40cf-a3b4-480d1afac349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:54.109615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b5b7-688e-40cf-a3b4-480d1afac349 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:54.126954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af609254-70c7-42bf-8ffc-dd69780aaac0 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:54.129937 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-af609254-70c7-42bf-8ffc-dd69780aaac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:54.151735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 873/1760] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:54.244096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:54.331878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9b5b7-688e-40cf-a3b4-480d1afac349 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:54.342476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9b5b7-688e-40cf-a3b4-480d1afac349 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:54.349350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8952c5-8649-405c-b4d1-150e03a440e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:54.351852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8952c5-8649-405c-b4d1-150e03a440e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:54.352203 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8952c5-8649-405c-b4d1-150e03a440e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:54.352435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8952c5-8649-405c-b4d1-150e03a440e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:54.358176 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4e8952c5-8649-405c-b4d1-150e03a440e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:54.383688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af609254-70c7-42bf-8ffc-dd69780aaac0 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:54.394511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:54.399889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:54.399889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:54.399889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] PATH_INFO: `/v3/projects/7672f3e82d4d4ce294c7a5176ff6e0f5` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:54.399889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7672f3e82d4d4ce294c7a5176ff6e0f5)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:54.404311 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:54.404772 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:54.510833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8952c5-8649-405c-b4d1-150e03a440e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:54.514711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8952c5-8649-405c-b4d1-150e03a440e3 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:54.517890 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7672f3e82d4d4ce294c7a5176ff6e0f5', 'request_id': 'req-de5b5e9c-76c7-44ef-833e-d0d3b039f600'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:54.527340 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7672f3e82d4d4ce294c7a5176ff6e0f5', 'request_id': 'req-de5b5e9c-76c7-44ef-833e-d0d3b039f600'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:54.534877 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7672f3e82d4d4ce294c7a5176ff6e0f5', 'request_id': 'req-de5b5e9c-76c7-44ef-833e-d0d3b039f600'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:54.558514 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 874/1761] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:23:54.560138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1be56-1896-4b5a-912d-351ebbd8183f None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:54.560438 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1be56-1896-4b5a-912d-351ebbd8183f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:54.560732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1be56-1896-4b5a-912d-351ebbd8183f None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:54.562235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 875/1762] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 08:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:23:54.563396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] The token cache is being invalidate because project 7672f3e82d4d4ce294c7a5176ff6e0f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:23:54.563902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:54.564940 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de5b5e9c-76c7-44ef-833e-d0d3b039f600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:54.567421 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 888/1763] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:23:54 2022] DELETE /identity/v3/projects/7672f3e82d4d4ce294c7a5176ff6e0f5 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:54.571494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1be56-1896-4b5a-912d-351ebbd8183f None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:54.579332 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6fc1be56-1896-4b5a-912d-351ebbd8183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:54.585240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ab93-21dc-43b2-b800-f1eaeda8df00 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:54.585625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ab93-21dc-43b2-b800-f1eaeda8df00 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:54.585969 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ab93-21dc-43b2-b800-f1eaeda8df00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:54.618307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-56c7ab93-21dc-43b2-b800-f1eaeda8df00 None None] MFA Rules not processed for user `93143507a8784a30bc6b4a5e1f24f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:54.620001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-56c7ab93-21dc-43b2-b800-f1eaeda8df00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:54.821304 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1be56-1896-4b5a-912d-351ebbd8183f None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:54.855234 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:54.863113 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:54.867000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:54.867420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] PATH_INFO: `/v3/users/e0f8468382d34a83ae78969788e17846` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:54.873409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f8468382d34a83ae78969788e17846)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:54.876564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:54.957383 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 889/1764] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 08:23:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:23:54.958423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ab93-21dc-43b2-b800-f1eaeda8df00 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:54.959921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-56c7ab93-21dc-43b2-b800-f1eaeda8df00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:55.005420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ab93-21dc-43b2-b800-f1eaeda8df00 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:55.025805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f8468382d34a83ae78969788e17846'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.028734 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f8468382d34a83ae78969788e17846'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.039901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:55.040534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:55.040856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:55.041139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] PATH_INFO: `/v3/projects/2f4977898f32432f855d02aac9c1fb33` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:55.046905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4977898f32432f855d02aac9c1fb33)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:55.049591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:55.063131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f8468382d34a83ae78969788e17846'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.097669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f8468382d34a83ae78969788e17846'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.099322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f8468382d34a83ae78969788e17846'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.129673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 876/1765] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:23:54 2022] DELETE /identity/v3/users/e0f8468382d34a83ae78969788e17846 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:55.133792 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:55.135926 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:55.257441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:55.273205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4977898f32432f855d02aac9c1fb33', 'request_id': 'req-c2f30731-9dfa-4a2f-9ada-c826e925b237'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.295481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4977898f32432f855d02aac9c1fb33', 'request_id': 'req-c2f30731-9dfa-4a2f-9ada-c826e925b237'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.296626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:55.317412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4977898f32432f855d02aac9c1fb33', 'request_id': 'req-c2f30731-9dfa-4a2f-9ada-c826e925b237'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.369434 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd6d65-9b4d-4aae-bcb8-03456586d4a3 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:55.371458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] The token cache is being invalidate because project 2f4977898f32432f855d02aac9c1fb33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:23:55.371761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.373961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.377258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 890/1766] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:23:54 2022] DELETE /identity/v3/projects/2f4977898f32432f855d02aac9c1fb33 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:55.384799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:55.386490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:55.584029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f30731-9dfa-4a2f-9ada-c826e925b237 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:55.585991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb0b2d-2fe3-4978-b5a5-b7789bcec27f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:55.586673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb0b2d-2fe3-4978-b5a5-b7789bcec27f service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:55.586956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb0b2d-2fe3-4978-b5a5-b7789bcec27f service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:55.587232 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb0b2d-2fe3-4978-b5a5-b7789bcec27f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:55.592147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-a7cb0b2d-2fe3-4978-b5a5-b7789bcec27f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:55.608305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:55.608986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:55.609298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:55.609761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] PATH_INFO: `/v3/users/914025a8155144c08d6932ecc94bb0d0` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:55.611662 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] RBAC: Authorizing `identity:delete_user(user_id=914025a8155144c08d6932ecc94bb0d0)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:55.613675 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:55.634743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb0b2d-2fe3-4978-b5a5-b7789bcec27f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:55.636481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb0b2d-2fe3-4978-b5a5-b7789bcec27f service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:55.688509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 877/1767] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:55.807781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914025a8155144c08d6932ecc94bb0d0'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.832387 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914025a8155144c08d6932ecc94bb0d0'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.848971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914025a8155144c08d6932ecc94bb0d0'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.852182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914025a8155144c08d6932ecc94bb0d0'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.889733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914025a8155144c08d6932ecc94bb0d0'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:55.909049 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 891/1768] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:23:55 2022] DELETE /identity/v3/users/914025a8155144c08d6932ecc94bb0d0 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:56.159814 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb0b2d-2fe3-4978-b5a5-b7789bcec27f service nova] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:56.161336 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-a7cb0b2d-2fe3-4978-b5a5-b7789bcec27f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:56.227339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb0b2d-2fe3-4978-b5a5-b7789bcec27f service nova] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:56.442975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:56.445101 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:56.445866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:56.446586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] PATH_INFO: `/v3/projects/9fee0393cc084646b63b119bc8815879` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:56.449730 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fee0393cc084646b63b119bc8815879)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:56.452697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:56.598828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fee0393cc084646b63b119bc8815879', 'request_id': 'req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:56.622789 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fee0393cc084646b63b119bc8815879', 'request_id': 'req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:56.631608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fee0393cc084646b63b119bc8815879', 'request_id': 'req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:56.635770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:56.638756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:56.642209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:56.671945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe6380-3a68-48d3-a62e-27f9b1c0921b admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:56.677866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] The token cache is being invalidate because project 9fee0393cc084646b63b119bc8815879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:23:56.678183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:56.682539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-10e2fd0f-9b8a-48cc-beb5-06c6e07103a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:56.694000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 878/1769] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:23:56 2022] DELETE /identity/v3/projects/9fee0393cc084646b63b119bc8815879 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:56.701239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f1743-11c2-4c6f-8a45-b0254db3f201 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:56.703411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f1743-11c2-4c6f-8a45-b0254db3f201 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:56.703899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f1743-11c2-4c6f-8a45-b0254db3f201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:56.741237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-0b7f1743-11c2-4c6f-8a45-b0254db3f201 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:56.742923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0b7f1743-11c2-4c6f-8a45-b0254db3f201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:56.752031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:56.775057 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:56.776012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:56.779189 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:56.779465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] PATH_INFO: `/v3/projects/9973e894fe6744cab6d0a58bfcfc34ea` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:56.781320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9973e894fe6744cab6d0a58bfcfc34ea)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:56.783644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:56.893075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 879/1770] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:56.902892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d80ca6-a85b-4c19-b10b-74c2e882287a None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:56.903950 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d80ca6-a85b-4c19-b10b-74c2e882287a None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:56.904576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d80ca6-a85b-4c19-b10b-74c2e882287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:56.909724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9973e894fe6744cab6d0a58bfcfc34ea', 'request_id': 'req-642285f1-e7c0-4ea4-90fb-5d931f746b1d'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:56.931858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9973e894fe6744cab6d0a58bfcfc34ea', 'request_id': 'req-642285f1-e7c0-4ea4-90fb-5d931f746b1d'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:56.949672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-38d80ca6-a85b-4c19-b10b-74c2e882287a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:56.952089 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-38d80ca6-a85b-4c19-b10b-74c2e882287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:56.955414 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9973e894fe6744cab6d0a58bfcfc34ea', 'request_id': 'req-642285f1-e7c0-4ea4-90fb-5d931f746b1d'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:56.985529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] The token cache is being invalidate because project 9973e894fe6744cab6d0a58bfcfc34ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:23:56.985829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:56.990124 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:56.995725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 892/1771] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:23:56 2022] DELETE /identity/v3/projects/9973e894fe6744cab6d0a58bfcfc34ea => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:57.000731 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:57.002765 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:57.105759 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 880/1772] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:57.109912 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d80ca6-a85b-4c19-b10b-74c2e882287a None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:57.123936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d80ca6-a85b-4c19-b10b-74c2e882287a None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:57.130460 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fa866-d47d-411e-8bcf-fb4124d5daa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:57.131321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa866-d47d-411e-8bcf-fb4124d5daa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:57.131683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa866-d47d-411e-8bcf-fb4124d5daa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:57.132027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fa866-d47d-411e-8bcf-fb4124d5daa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:57.133052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fa866-d47d-411e-8bcf-fb4124d5daa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:23:57.133142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fa866-d47d-411e-8bcf-fb4124d5daa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:57.135081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fa866-d47d-411e-8bcf-fb4124d5daa5 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:57.180512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 881/1773] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:23:57.181767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fa866-d47d-411e-8bcf-fb4124d5daa5 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:57.196534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642285f1-e7c0-4ea4-90fb-5d931f746b1d admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:57.201903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fa866-d47d-411e-8bcf-fb4124d5daa5 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:57.211154 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:57.211947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:57.212236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:57.212519 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] PATH_INFO: `/v3/users/66f05f1a87cd449cb04c6aa091d75606` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:57.213152 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510960-8587-4118-9e6c-c2de8f3dd383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:57.213793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510960-8587-4118-9e6c-c2de8f3dd383 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:57.214116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510960-8587-4118-9e6c-c2de8f3dd383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:57.214397 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510960-8587-4118-9e6c-c2de8f3dd383 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:57.215084 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e510960-8587-4118-9e6c-c2de8f3dd383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:57.217038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e510960-8587-4118-9e6c-c2de8f3dd383 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:57.218569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f05f1a87cd449cb04c6aa091d75606)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:57.220685 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:57.275368 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 882/1774] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:57 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:57.283107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510960-8587-4118-9e6c-c2de8f3dd383 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:57.322312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f05f1a87cd449cb04c6aa091d75606'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:57.339662 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f05f1a87cd449cb04c6aa091d75606'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:57.361472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f05f1a87cd449cb04c6aa091d75606'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:57.362750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f05f1a87cd449cb04c6aa091d75606'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:57.424099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:57.432780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f05f1a87cd449cb04c6aa091d75606'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:57.455685 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 893/1775] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:23:56 2022] DELETE /identity/v3/users/66f05f1a87cd449cb04c6aa091d75606 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:57.524020 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510960-8587-4118-9e6c-c2de8f3dd383 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:57.542822 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:57.754714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355e6a8-8d9f-41a6-b3aa-998b1c08e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:57.757852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355e6a8-8d9f-41a6-b3aa-998b1c08e01d admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:57.758295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355e6a8-8d9f-41a6-b3aa-998b1c08e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:57.758742 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355e6a8-8d9f-41a6-b3aa-998b1c08e01d admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:57.760278 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355e6a8-8d9f-41a6-b3aa-998b1c08e01d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:57.764192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355e6a8-8d9f-41a6-b3aa-998b1c08e01d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:57.875501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 883/1776] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:57 2022] POST /identity/v3/users => generated 284 bytes in 592 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:57.876420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:57.878620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:57.923578 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd796cdc-27dc-42d8-84a1-74145fb4a05c admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:57.948858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a628fa-ba8f-4d85-8795-7d528bda790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:57.954159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a628fa-ba8f-4d85-8795-7d528bda790a admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:57.954909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a628fa-ba8f-4d85-8795-7d528bda790a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:57.955325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a628fa-ba8f-4d85-8795-7d528bda790a admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:57.956605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a628fa-ba8f-4d85-8795-7d528bda790a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:57.958928 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a628fa-ba8f-4d85-8795-7d528bda790a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:57.997428 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 894/1777] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:58.001557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355e6a8-8d9f-41a6-b3aa-998b1c08e01d admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:58.028935 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355e6a8-8d9f-41a6-b3aa-998b1c08e01d admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:58.054509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77376770-5544-4fb7-98f3-33ccf98bec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:58.055192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376770-5544-4fb7-98f3-33ccf98bec50 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:58.055478 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376770-5544-4fb7-98f3-33ccf98bec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:58.056143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77376770-5544-4fb7-98f3-33ccf98bec50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:58.063202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77376770-5544-4fb7-98f3-33ccf98bec50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:58.072090 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77376770-5544-4fb7-98f3-33ccf98bec50 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:58.126735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 884/1778] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:23:58.131392 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a628fa-ba8f-4d85-8795-7d528bda790a admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:58.146141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a628fa-ba8f-4d85-8795-7d528bda790a admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:58.178425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0587503-31ec-4dd6-84ac-57aee31c2caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:58.181928 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0587503-31ec-4dd6-84ac-57aee31c2caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:58.185675 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0587503-31ec-4dd6-84ac-57aee31c2caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:58.186926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0587503-31ec-4dd6-84ac-57aee31c2caa admin admin] PATH_INFO: `/v3/projects/d761f628a5284d1b8f2fb0c6394b4669/users/4c894402c6c04b32b7b6a0fd67e713cd/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:58.230342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9dceb-71fd-4f5e-b410-5c06dad49b7f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:58.230628 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9dceb-71fd-4f5e-b410-5c06dad49b7f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:58.234791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9dceb-71fd-4f5e-b410-5c06dad49b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:58.301777 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0587503-31ec-4dd6-84ac-57aee31c2caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d761f628a5284d1b8f2fb0c6394b4669, user_id=4c894402c6c04b32b7b6a0fd67e713cd, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:58.305592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0587503-31ec-4dd6-84ac-57aee31c2caa admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:58.327130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-12e9dceb-71fd-4f5e-b410-5c06dad49b7f None None] MFA Rules not processed for user `7d9879cce3dc43178f196dbe9294c8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:58.332444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-12e9dceb-71fd-4f5e-b410-5c06dad49b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:58.357876 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 895/1779] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:58 2022] PUT /identity/v3/projects/d761f628a5284d1b8f2fb0c6394b4669/users/4c894402c6c04b32b7b6a0fd67e713cd/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:58.370239 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532714d-c03a-4058-95ac-ed558cc681f8 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:58.370541 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532714d-c03a-4058-95ac-ed558cc681f8 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:58.370817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532714d-c03a-4058-95ac-ed558cc681f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:58.497937 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-0532714d-c03a-4058-95ac-ed558cc681f8 None None] MFA Rules not processed for user `4c894402c6c04b32b7b6a0fd67e713cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:58.499370 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-0532714d-c03a-4058-95ac-ed558cc681f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:58.579323 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 885/1780] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:58.688248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9dceb-71fd-4f5e-b410-5c06dad49b7f None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:58.691806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-12e9dceb-71fd-4f5e-b410-5c06dad49b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:58.694691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 896/1781] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:23:58.696781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532714d-c03a-4058-95ac-ed558cc681f8 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:58.742706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9dceb-71fd-4f5e-b410-5c06dad49b7f None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:58.955080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960fa4e-9af8-4067-9dde-fa010b8b15d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:58.956680 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960fa4e-9af8-4067-9dde-fa010b8b15d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:58.957248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960fa4e-9af8-4067-9dde-fa010b8b15d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:58.957703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960fa4e-9af8-4067-9dde-fa010b8b15d1 admin admin] PATH_INFO: `/v3/users/1de8f15bdb234fb194c52d969d60fdef` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:58.959184 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960fa4e-9af8-4067-9dde-fa010b8b15d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de8f15bdb234fb194c52d969d60fdef)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:58.961601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9960fa4e-9af8-4067-9dde-fa010b8b15d1 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:59.014856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:59.036436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532714d-c03a-4058-95ac-ed558cc681f8 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:59.045275 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9960fa4e-9af8-4067-9dde-fa010b8b15d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de8f15bdb234fb194c52d969d60fdef'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:59.046578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9960fa4e-9af8-4067-9dde-fa010b8b15d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de8f15bdb234fb194c52d969d60fdef'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:59.055111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596187-6a23-4e3e-ae24-c80f3e7df76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:59.056305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596187-6a23-4e3e-ae24-c80f3e7df76f admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:59.056817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596187-6a23-4e3e-ae24-c80f3e7df76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:59.057259 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596187-6a23-4e3e-ae24-c80f3e7df76f admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:59.058280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596187-6a23-4e3e-ae24-c80f3e7df76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:59.067096 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9960fa4e-9af8-4067-9dde-fa010b8b15d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de8f15bdb234fb194c52d969d60fdef'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:59.070712 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596187-6a23-4e3e-ae24-c80f3e7df76f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:59.103571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9960fa4e-9af8-4067-9dde-fa010b8b15d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de8f15bdb234fb194c52d969d60fdef'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:59.104344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9960fa4e-9af8-4067-9dde-fa010b8b15d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de8f15bdb234fb194c52d969d60fdef'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:23:59.132815 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 886/1782] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:23:58 2022] DELETE /identity/v3/users/1de8f15bdb234fb194c52d969d60fdef => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:23:59.137504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732736b-8dbe-425c-8b1c-dd550d191f38 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:59.137774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732736b-8dbe-425c-8b1c-dd550d191f38 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:59.138188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732736b-8dbe-425c-8b1c-dd550d191f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:59.163522 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 897/1783] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:23:58 2022] POST /identity/v3/projects => generated 369 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:59.172122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596187-6a23-4e3e-ae24-c80f3e7df76f admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:59.191278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-59596187-6a23-4e3e-ae24-c80f3e7df76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:59.197359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-f732736b-8dbe-425c-8b1c-dd550d191f38 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:23:59.198738 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-f732736b-8dbe-425c-8b1c-dd550d191f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:59.375128 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:23:59.395225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 887/1784] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:23:59.438819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732736b-8dbe-425c-8b1c-dd550d191f38 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:59.442042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-f732736b-8dbe-425c-8b1c-dd550d191f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:59.468394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596187-6a23-4e3e-ae24-c80f3e7df76f admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:59.494684 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3b853-c4f1-44ce-9c08-4037a394b997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:59.495593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3b853-c4f1-44ce-9c08-4037a394b997 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:59.496079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3b853-c4f1-44ce-9c08-4037a394b997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:59.496503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3b853-c4f1-44ce-9c08-4037a394b997 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:59.497332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3b853-c4f1-44ce-9c08-4037a394b997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:59.499750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3b853-c4f1-44ce-9c08-4037a394b997 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:59.551544 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 898/1785] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:23:59 2022] POST /identity/v3/users => generated 291 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:23:59.556356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3b853-c4f1-44ce-9c08-4037a394b997 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:59.570809 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3b853-c4f1-44ce-9c08-4037a394b997 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:59.576203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8257-420d-4a97-8ce5-32a84c9ce1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:59.576829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8257-420d-4a97-8ce5-32a84c9ce1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:59.577940 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8257-420d-4a97-8ce5-32a84c9ce1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:59.577940 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8257-420d-4a97-8ce5-32a84c9ce1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:59.578504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8257-420d-4a97-8ce5-32a84c9ce1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:59.580005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8257-420d-4a97-8ce5-32a84c9ce1d7 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:59.594605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 899/1786] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:23:59.598401 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8257-420d-4a97-8ce5-32a84c9ce1d7 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:59.610813 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8257-420d-4a97-8ce5-32a84c9ce1d7 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:59.618072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732736b-8dbe-425c-8b1c-dd550d191f38 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:59.621136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da937159-ac8d-4437-a5ef-ad8b1ded314f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:59.622235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da937159-ac8d-4437-a5ef-ad8b1ded314f admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:59.622506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da937159-ac8d-4437-a5ef-ad8b1ded314f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:59.622766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80d6a7-97b3-46ff-bc9c-e15123817b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:59.622981 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da937159-ac8d-4437-a5ef-ad8b1ded314f admin admin] PATH_INFO: `/v3/projects/faa99884a2a34f93ac40c00fedb3b00c/users/5dcf59085b054d4f9490516494882804/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:59.623302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80d6a7-97b3-46ff-bc9c-e15123817b4b service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:59.623623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80d6a7-97b3-46ff-bc9c-e15123817b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:59.624045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80d6a7-97b3-46ff-bc9c-e15123817b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:59.655206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80d6a7-97b3-46ff-bc9c-e15123817b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:59.659580 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80d6a7-97b3-46ff-bc9c-e15123817b4b service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:59.664573 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da937159-ac8d-4437-a5ef-ad8b1ded314f admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa99884a2a34f93ac40c00fedb3b00c, user_id=5dcf59085b054d4f9490516494882804, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:59.670556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da937159-ac8d-4437-a5ef-ad8b1ded314f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:59.698970 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 900/1787] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:59 2022] PUT /identity/v3/projects/faa99884a2a34f93ac40c00fedb3b00c/users/5dcf59085b054d4f9490516494882804/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:23:59.703399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 888/1788] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:23:59.704723 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da937159-ac8d-4437-a5ef-ad8b1ded314f admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:59.902049 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da937159-ac8d-4437-a5ef-ad8b1ded314f admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:59.919863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa0509-0a3b-4732-9d12-e471451c924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:59.920967 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa0509-0a3b-4732-9d12-e471451c924d admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:59.921456 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa0509-0a3b-4732-9d12-e471451c924d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:59.921935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa0509-0a3b-4732-9d12-e471451c924d admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:59.922880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa0509-0a3b-4732-9d12-e471451c924d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:59.925400 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa0509-0a3b-4732-9d12-e471451c924d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:23:59.932749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80d6a7-97b3-46ff-bc9c-e15123817b4b service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:59.933979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ab80d6a7-97b3-46ff-bc9c-e15123817b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:23:59.945218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 901/1789] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:23:59.950121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa0509-0a3b-4732-9d12-e471451c924d admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:23:59.962689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80d6a7-97b3-46ff-bc9c-e15123817b4b service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:59.975622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa0509-0a3b-4732-9d12-e471451c924d admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:23:59.986309 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a938dad-9c9a-4d38-849d-8ac2bec36a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:23:59.987510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a938dad-9c9a-4d38-849d-8ac2bec36a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:23:59.987995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a938dad-9c9a-4d38-849d-8ac2bec36a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:23:59.988476 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a938dad-9c9a-4d38-849d-8ac2bec36a76 admin admin] PATH_INFO: `/v3/projects/faa99884a2a34f93ac40c00fedb3b00c/users/5dcf59085b054d4f9490516494882804/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:23:59.993140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a938dad-9c9a-4d38-849d-8ac2bec36a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa99884a2a34f93ac40c00fedb3b00c, user_id=5dcf59085b054d4f9490516494882804, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:23:59.996644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a938dad-9c9a-4d38-849d-8ac2bec36a76 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:00.001444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:00.004389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:00.004679 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:00.008265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] PATH_INFO: `/v3/projects/084f73a72a51490d86eccf65e2360275` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:00.014966 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=084f73a72a51490d86eccf65e2360275)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:00.020413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:00.033538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 902/1790] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:23:59 2022] PUT /identity/v3/projects/faa99884a2a34f93ac40c00fedb3b00c/users/5dcf59085b054d4f9490516494882804/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:00.044914 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b281247-5ae8-48bf-9cde-ea45377e6d18 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:00.046036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b281247-5ae8-48bf-9cde-ea45377e6d18 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:00.046909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b281247-5ae8-48bf-9cde-ea45377e6d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:00.102608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-9b281247-5ae8-48bf-9cde-ea45377e6d18 None None] MFA Rules not processed for user `5dcf59085b054d4f9490516494882804`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:00.105242 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9b281247-5ae8-48bf-9cde-ea45377e6d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:00.159428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:00.161715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084f73a72a51490d86eccf65e2360275', 'request_id': 'req-2e534de3-6fdc-4035-997b-4e8876a5c7ce'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:00.172512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084f73a72a51490d86eccf65e2360275', 'request_id': 'req-2e534de3-6fdc-4035-997b-4e8876a5c7ce'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:00.191357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084f73a72a51490d86eccf65e2360275', 'request_id': 'req-2e534de3-6fdc-4035-997b-4e8876a5c7ce'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:00.223489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] The token cache is being invalidate because project 084f73a72a51490d86eccf65e2360275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:00.224092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:00.226044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-2e534de3-6fdc-4035-997b-4e8876a5c7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:00.231145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 889/1791] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:23:59 2022] DELETE /identity/v3/projects/084f73a72a51490d86eccf65e2360275 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:00.241428 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:00.247098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fff2b4-3a34-4b86-a933-0d3d41731015 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:00.247665 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fff2b4-3a34-4b86-a933-0d3d41731015 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:00.252084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 903/1792] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:00.252358 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fff2b4-3a34-4b86-a933-0d3d41731015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:00.261177 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b281247-5ae8-48bf-9cde-ea45377e6d18 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:00.263460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9b281247-5ae8-48bf-9cde-ea45377e6d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:00.323683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-b9fff2b4-3a34-4b86-a933-0d3d41731015 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:00.325078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b9fff2b4-3a34-4b86-a933-0d3d41731015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:00.442729 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b281247-5ae8-48bf-9cde-ea45377e6d18 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:00.490838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 890/1793] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:00.498994 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298b92f-d146-4242-a25a-c14181496c29 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:00.499779 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298b92f-d146-4242-a25a-c14181496c29 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:00.500079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298b92f-d146-4242-a25a-c14181496c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:00.545340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6298b92f-d146-4242-a25a-c14181496c29 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:00.545340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6298b92f-d146-4242-a25a-c14181496c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:00.572796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 891/1794] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:00.573810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298b92f-d146-4242-a25a-c14181496c29 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:00.593553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b71fe5-90e0-4422-9155-eeafd134ac75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:00.594558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b71fe5-90e0-4422-9155-eeafd134ac75 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:00.595062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b71fe5-90e0-4422-9155-eeafd134ac75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:00.595324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b71fe5-90e0-4422-9155-eeafd134ac75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:00.595423 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298b92f-d146-4242-a25a-c14181496c29 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:00.608873 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68991ba-cc22-44d2-9093-4a7ad8cadec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:00.609535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68991ba-cc22-44d2-9093-4a7ad8cadec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:00.609818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68991ba-cc22-44d2-9093-4a7ad8cadec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:00.610120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68991ba-cc22-44d2-9093-4a7ad8cadec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:00.610838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68991ba-cc22-44d2-9093-4a7ad8cadec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:00.611150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68991ba-cc22-44d2-9093-4a7ad8cadec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:00.614675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68991ba-cc22-44d2-9093-4a7ad8cadec1 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:00.616780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-50b71fe5-90e0-4422-9155-eeafd134ac75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:00.657882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 892/1795] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:00.663755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf572a-a6fb-445c-bafb-c92d34dc64e3 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:00.664115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf572a-a6fb-445c-bafb-c92d34dc64e3 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:00.664301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf572a-a6fb-445c-bafb-c92d34dc64e3 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:00.665677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 893/1796] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 2 08:24:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:24:00.669302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf572a-a6fb-445c-bafb-c92d34dc64e3 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:00.700631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf572a-a6fb-445c-bafb-c92d34dc64e3 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:00.712550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb347c-6aae-4bc4-85b8-e61a048e4016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:00.713203 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb347c-6aae-4bc4-85b8-e61a048e4016 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:00.713493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb347c-6aae-4bc4-85b8-e61a048e4016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:00.713771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb347c-6aae-4bc4-85b8-e61a048e4016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:00.714505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb347c-6aae-4bc4-85b8-e61a048e4016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:00.716418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb347c-6aae-4bc4-85b8-e61a048e4016 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:00.806377 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 894/1797] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:00 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:00.809282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ce82d-4c09-4fdf-a186-4065f723301c None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:00.811375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ce82d-4c09-4fdf-a186-4065f723301c None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:00.812987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ce82d-4c09-4fdf-a186-4065f723301c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:00.847919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-dc3ce82d-4c09-4fdf-a186-4065f723301c None None] MFA Rules not processed for user `e68c134016414ea5b851bde233ed9951`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:00.849654 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-dc3ce82d-4c09-4fdf-a186-4065f723301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:00.881720 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b71fe5-90e0-4422-9155-eeafd134ac75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:00.893906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b71fe5-90e0-4422-9155-eeafd134ac75 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:00.928605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 904/1798] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:00.929392 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b71fe5-90e0-4422-9155-eeafd134ac75 service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:00.961639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b71fe5-90e0-4422-9155-eeafd134ac75 service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:00.971554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 895/1799] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:24:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:01.019496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ce82d-4c09-4fdf-a186-4065f723301c None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:01.021143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-dc3ce82d-4c09-4fdf-a186-4065f723301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:01.149440 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef22da1-0007-42c7-b32b-539ea4afdeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:01.150060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef22da1-0007-42c7-b32b-539ea4afdeec admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:01.150599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef22da1-0007-42c7-b32b-539ea4afdeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:01.151349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef22da1-0007-42c7-b32b-539ea4afdeec admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:01.154558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef22da1-0007-42c7-b32b-539ea4afdeec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:01.159639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef22da1-0007-42c7-b32b-539ea4afdeec admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:01.175787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:01.180366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:01.209649 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ce82d-4c09-4fdf-a186-4065f723301c None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:01.221928 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 905/1800] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:00 2022] POST /identity/v3/users => generated 296 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:01.224096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef22da1-0007-42c7-b32b-539ea4afdeec admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:01.226653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ead9e-5204-4b1a-95ad-d5057c2b9b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:01.226973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ead9e-5204-4b1a-95ad-d5057c2b9b3e service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:01.227249 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ead9e-5204-4b1a-95ad-d5057c2b9b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:01.227519 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ead9e-5204-4b1a-95ad-d5057c2b9b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:01.238303 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-aa1ead9e-5204-4b1a-95ad-d5057c2b9b3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:01.253999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef22da1-0007-42c7-b32b-539ea4afdeec admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:01.277481 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4e90d-f160-4a0d-804f-7e555464c58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:01.278153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4e90d-f160-4a0d-804f-7e555464c58b admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:01.278436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4e90d-f160-4a0d-804f-7e555464c58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:01.278710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4e90d-f160-4a0d-804f-7e555464c58b admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:01.279423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4e90d-f160-4a0d-804f-7e555464c58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:01.281071 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4e90d-f160-4a0d-804f-7e555464c58b admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:01.305755 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 906/1801] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:01.309168 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4e90d-f160-4a0d-804f-7e555464c58b admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:01.330391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4e90d-f160-4a0d-804f-7e555464c58b admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:01.342472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584075de-e5c8-4469-b259-fe1b852027e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:01.343097 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584075de-e5c8-4469-b259-fe1b852027e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:01.343433 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584075de-e5c8-4469-b259-fe1b852027e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:01.343757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584075de-e5c8-4469-b259-fe1b852027e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:01.344340 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584075de-e5c8-4469-b259-fe1b852027e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:01.346121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584075de-e5c8-4469-b259-fe1b852027e2 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:01.374265 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 907/1802] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:01.375352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584075de-e5c8-4469-b259-fe1b852027e2 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:01.420035 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584075de-e5c8-4469-b259-fe1b852027e2 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:01.432368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a2411-fa06-4a24-a578-3da3dc51ff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:01.433118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a2411-fa06-4a24-a578-3da3dc51ff5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:01.433558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a2411-fa06-4a24-a578-3da3dc51ff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:01.433809 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a2411-fa06-4a24-a578-3da3dc51ff5f admin admin] PATH_INFO: `/v3/projects/9a9fbd97057646449b280e76988e3e46/users/0795758d72a3468295d72637c6d68271/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:01.484554 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a2411-fa06-4a24-a578-3da3dc51ff5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9fbd97057646449b280e76988e3e46, user_id=0795758d72a3468295d72637c6d68271, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:01.487258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a2411-fa06-4a24-a578-3da3dc51ff5f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:01.493630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ead9e-5204-4b1a-95ad-d5057c2b9b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:01.496883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ead9e-5204-4b1a-95ad-d5057c2b9b3e service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:01.527055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 908/1803] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:01 2022] PUT /identity/v3/projects/9a9fbd97057646449b280e76988e3e46/users/0795758d72a3468295d72637c6d68271/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:01.546542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee52d6-3f13-4788-a594-aa24541a06d2 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:01.547093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee52d6-3f13-4788-a594-aa24541a06d2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:01.547619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee52d6-3f13-4788-a594-aa24541a06d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:01.550785 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 896/1804] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:01.574675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ead9e-5204-4b1a-95ad-d5057c2b9b3e service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:01.582888 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-aa1ead9e-5204-4b1a-95ad-d5057c2b9b3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:01.633881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-f5ee52d6-3f13-4788-a594-aa24541a06d2 None None] MFA Rules not processed for user `0795758d72a3468295d72637c6d68271`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:01.636182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f5ee52d6-3f13-4788-a594-aa24541a06d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:01.649920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ead9e-5204-4b1a-95ad-d5057c2b9b3e service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:01.902373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 909/1805] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:01.904140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee52d6-3f13-4788-a594-aa24541a06d2 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:01.926533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8daf9-76d1-46d0-af15-3cb0b2c54456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:01.926933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8daf9-76d1-46d0-af15-3cb0b2c54456 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:01.934357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8daf9-76d1-46d0-af15-3cb0b2c54456 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:01.934805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e8daf9-76d1-46d0-af15-3cb0b2c54456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:01.967544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8daf9-76d1-46d0-af15-3cb0b2c54456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:01.969474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e8daf9-76d1-46d0-af15-3cb0b2c54456 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:01.997778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 897/1806] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:01.998805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8daf9-76d1-46d0-af15-3cb0b2c54456 service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:02.003092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-80e8daf9-76d1-46d0-af15-3cb0b2c54456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:02.062866 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee52d6-3f13-4788-a594-aa24541a06d2 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:02.083512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac809b-48de-47ad-8b4d-3c171c04448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:02.083512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac809b-48de-47ad-8b4d-3c171c04448d admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:02.084388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac809b-48de-47ad-8b4d-3c171c04448d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:02.084461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac809b-48de-47ad-8b4d-3c171c04448d admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:02.085108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac809b-48de-47ad-8b4d-3c171c04448d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:02.087055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac809b-48de-47ad-8b4d-3c171c04448d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:02.150122 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 910/1807] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:01 2022] POST /identity/v3/projects => generated 391 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:02.153882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac809b-48de-47ad-8b4d-3c171c04448d admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:02.164079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e8daf9-76d1-46d0-af15-3cb0b2c54456 service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:02.195531 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:02.251932 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac809b-48de-47ad-8b4d-3c171c04448d admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:02.257747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:02.272745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15d723-ef08-4465-b888-02bce10f8ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:02.275827 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d723-ef08-4465-b888-02bce10f8ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:02.276297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d723-ef08-4465-b888-02bce10f8ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:02.276738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15d723-ef08-4465-b888-02bce10f8ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:02.277661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15d723-ef08-4465-b888-02bce10f8ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:02.277784 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:02.279707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:02.279999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:02.280289 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] PATH_INFO: `/v3/projects/d732c3902e614240a679103202da89fd` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:02.281498 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15d723-ef08-4465-b888-02bce10f8ee2 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:02.302484 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d732c3902e614240a679103202da89fd)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:02.306748 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:02.333360 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 911/1808] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:02 2022] POST /identity/v3/users => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:02.337847 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15d723-ef08-4465-b888-02bce10f8ee2 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:02.359406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15d723-ef08-4465-b888-02bce10f8ee2 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:02.369656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b246d0-2105-4930-8786-5ec6dd58174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:02.370245 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b246d0-2105-4930-8786-5ec6dd58174e admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:02.370525 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b246d0-2105-4930-8786-5ec6dd58174e admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:02.370796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b246d0-2105-4930-8786-5ec6dd58174e admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:02.371537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b246d0-2105-4930-8786-5ec6dd58174e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:02.373114 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b246d0-2105-4930-8786-5ec6dd58174e admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:02.400283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 912/1809] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:02.404536 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b246d0-2105-4930-8786-5ec6dd58174e admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:02.428494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd732c3902e614240a679103202da89fd', 'request_id': 'req-0199f077-3998-49a2-9c81-d11503a09790'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:02.432200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b246d0-2105-4930-8786-5ec6dd58174e admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:02.440396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd732c3902e614240a679103202da89fd', 'request_id': 'req-0199f077-3998-49a2-9c81-d11503a09790'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:02.458108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd732c3902e614240a679103202da89fd', 'request_id': 'req-0199f077-3998-49a2-9c81-d11503a09790'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:02.479305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] The token cache is being invalidate because project d732c3902e614240a679103202da89fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:02.479649 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:02.480522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:02.482624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 898/1810] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:01 2022] DELETE /identity/v3/projects/d732c3902e614240a679103202da89fd => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:02.486392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:02.488244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:02.527529 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f464-efd8-4c8c-962a-0c84d955c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:02.528318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f464-efd8-4c8c-962a-0c84d955c7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:02.528601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f464-efd8-4c8c-962a-0c84d955c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:02.528875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f464-efd8-4c8c-962a-0c84d955c7ea admin admin] PATH_INFO: `/v3/projects/13ce24e3840e4f2d8513ea22ccf2ca33/users/2f48088251a1481bab463028a11fa801/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:02.550344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288f464-efd8-4c8c-962a-0c84d955c7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ce24e3840e4f2d8513ea22ccf2ca33, user_id=2f48088251a1481bab463028a11fa801, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:02.557301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288f464-efd8-4c8c-962a-0c84d955c7ea admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:02.578468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199f077-3998-49a2-9c81-d11503a09790 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:02.579636 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 913/1811] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:02 2022] PUT /identity/v3/projects/13ce24e3840e4f2d8513ea22ccf2ca33/users/2f48088251a1481bab463028a11fa801/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:02.583438 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f464-efd8-4c8c-962a-0c84d955c7ea admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:02.586181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e288f464-efd8-4c8c-962a-0c84d955c7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:02.678075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:02.678752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:02.679038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:02.679317 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] PATH_INFO: `/v3/users/b7b437b0ae7f482bae87c56d6d1b4649` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:02.680542 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b437b0ae7f482bae87c56d6d1b4649)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:02.680970 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f464-efd8-4c8c-962a-0c84d955c7ea admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:02.682551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:02.686425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b95b80-dade-48b9-bc0e-396cd90f62a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:02.687067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b95b80-dade-48b9-bc0e-396cd90f62a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:02.687348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b95b80-dade-48b9-bc0e-396cd90f62a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:02.687624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b95b80-dade-48b9-bc0e-396cd90f62a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:02.688332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b95b80-dade-48b9-bc0e-396cd90f62a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:02.690148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b95b80-dade-48b9-bc0e-396cd90f62a1 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:02.701353 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 914/1812] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:02.705394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b95b80-dade-48b9-bc0e-396cd90f62a1 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:02.718720 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:02.720600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b95b80-dade-48b9-bc0e-396cd90f62a1 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:02.727215 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b96ce6-3a01-49da-9034-e2c5fce440ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:02.728184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b96ce6-3a01-49da-9034-e2c5fce440ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:02.728184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b96ce6-3a01-49da-9034-e2c5fce440ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:02.728505 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b96ce6-3a01-49da-9034-e2c5fce440ba admin admin] PATH_INFO: `/v3/projects/13ce24e3840e4f2d8513ea22ccf2ca33/users/2f48088251a1481bab463028a11fa801/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:02.731461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b96ce6-3a01-49da-9034-e2c5fce440ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ce24e3840e4f2d8513ea22ccf2ca33, user_id=2f48088251a1481bab463028a11fa801, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:02.734608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b96ce6-3a01-49da-9034-e2c5fce440ba admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:02.746570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b437b0ae7f482bae87c56d6d1b4649'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:02.747222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 915/1813] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:02 2022] PUT /identity/v3/projects/13ce24e3840e4f2d8513ea22ccf2ca33/users/2f48088251a1481bab463028a11fa801/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:02.750443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b437b0ae7f482bae87c56d6d1b4649'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:02.758225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc36bf-bebe-4630-9606-6417e19fc220 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:02.758601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc36bf-bebe-4630-9606-6417e19fc220 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:02.758947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc36bf-bebe-4630-9606-6417e19fc220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:02.763443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b437b0ae7f482bae87c56d6d1b4649'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:02.777980 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b437b0ae7f482bae87c56d6d1b4649'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:02.778437 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:02.778742 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b437b0ae7f482bae87c56d6d1b4649'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:02.793920 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-76fc36bf-bebe-4630-9606-6417e19fc220 None None] MFA Rules not processed for user `2f48088251a1481bab463028a11fa801`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:02.795538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-76fc36bf-bebe-4630-9606-6417e19fc220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:02.795658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 899/1814] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:02 2022] DELETE /identity/v3/users/b7b437b0ae7f482bae87c56d6d1b4649 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:02.911163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 916/1815] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:02.930204 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:02.931954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:03.090523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e3c0f-0df2-4cbc-9cd1-94e1ed204fd2 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:03.101955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7c2cf-0c74-4da1-9548-cb978e2f9934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:03.102641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7c2cf-0c74-4da1-9548-cb978e2f9934 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:03.102920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7c2cf-0c74-4da1-9548-cb978e2f9934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:03.103190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7c2cf-0c74-4da1-9548-cb978e2f9934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:03.130370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7c2cf-0c74-4da1-9548-cb978e2f9934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:03.134107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7c2cf-0c74-4da1-9548-cb978e2f9934 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:03.159313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 900/1816] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:03.204540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc36bf-bebe-4630-9606-6417e19fc220 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:03.206159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-76fc36bf-bebe-4630-9606-6417e19fc220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:03.311307 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7c2cf-0c74-4da1-9548-cb978e2f9934 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:03.323030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7c2cf-0c74-4da1-9548-cb978e2f9934 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:03.331964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b5b98-971e-47e3-8b40-90235d0aaa6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:03.332602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b5b98-971e-47e3-8b40-90235d0aaa6d service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:03.332882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b5b98-971e-47e3-8b40-90235d0aaa6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:03.333154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b5b98-971e-47e3-8b40-90235d0aaa6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:03.342425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-af8b5b98-971e-47e3-8b40-90235d0aaa6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:03.385579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc36bf-bebe-4630-9606-6417e19fc220 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:03.407810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:03.408649 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:03.408917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:03.409733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] PATH_INFO: `/v3/projects/2fcce107aaf94ac79a8588ca4a15c43d` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:03.416109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcce107aaf94ac79a8588ca4a15c43d)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:03.418340 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:03.469049 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b5b98-971e-47e3-8b40-90235d0aaa6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:03.473180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b5b98-971e-47e3-8b40-90235d0aaa6d service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:03.507202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 901/1817] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:03.576781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcce107aaf94ac79a8588ca4a15c43d', 'request_id': 'req-83531455-e1f5-4224-b2d2-7d81a8acde54'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:03.591922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcce107aaf94ac79a8588ca4a15c43d', 'request_id': 'req-83531455-e1f5-4224-b2d2-7d81a8acde54'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:03.632152 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcce107aaf94ac79a8588ca4a15c43d', 'request_id': 'req-83531455-e1f5-4224-b2d2-7d81a8acde54'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:03.674919 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] The token cache is being invalidate because project 2fcce107aaf94ac79a8588ca4a15c43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:03.675374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:03.682608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83531455-e1f5-4224-b2d2-7d81a8acde54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:03.687364 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 917/1818] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:03 2022] DELETE /identity/v3/projects/2fcce107aaf94ac79a8588ca4a15c43d => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:03.692420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1aaf-55e4-4cce-b8ab-6856b060b0ac None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:03.692714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1aaf-55e4-4cce-b8ab-6856b060b0ac None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:03.693511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1aaf-55e4-4cce-b8ab-6856b060b0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:03.753205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-cc8f1aaf-55e4-4cce-b8ab-6856b060b0ac None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:03.755148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-cc8f1aaf-55e4-4cce-b8ab-6856b060b0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:03.827455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:03.893584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 902/1819] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:03.902618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec20317-8afe-43ae-b649-9b39874b0260 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:03.903975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec20317-8afe-43ae-b649-9b39874b0260 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:03.904321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec20317-8afe-43ae-b649-9b39874b0260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:03.940410 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-7ec20317-8afe-43ae-b649-9b39874b0260 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:03.942214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7ec20317-8afe-43ae-b649-9b39874b0260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:03.961026 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 918/1820] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:03.965380 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f1aaf-55e4-4cce-b8ab-6856b060b0ac None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:03.978900 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f1aaf-55e4-4cce-b8ab-6856b060b0ac None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:03.986933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31060f23-b5a0-4ff0-9331-0e07c7e62dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:03.987643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31060f23-b5a0-4ff0-9331-0e07c7e62dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:03.987992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31060f23-b5a0-4ff0-9331-0e07c7e62dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:03.988338 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31060f23-b5a0-4ff0-9331-0e07c7e62dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:03.989111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31060f23-b5a0-4ff0-9331-0e07c7e62dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:03.989565 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31060f23-b5a0-4ff0-9331-0e07c7e62dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:03.996106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31060f23-b5a0-4ff0-9331-0e07c7e62dfd admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:04.013442 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 903/1821] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:04.019425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec20317-8afe-43ae-b649-9b39874b0260 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:04.048232 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec20317-8afe-43ae-b649-9b39874b0260 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:04.062391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d1155-30d9-4322-90cd-155c28644358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:04.063181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d1155-30d9-4322-90cd-155c28644358 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:04.063564 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d1155-30d9-4322-90cd-155c28644358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:04.063941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d1155-30d9-4322-90cd-155c28644358 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:04.067448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d1155-30d9-4322-90cd-155c28644358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:04.072524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d1155-30d9-4322-90cd-155c28644358 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:04.119259 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:04.155497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31060f23-b5a0-4ff0-9331-0e07c7e62dfd admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:04.156789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 919/1822] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:04 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:04.171908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31060f23-b5a0-4ff0-9331-0e07c7e62dfd admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:04.303652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0cc4d-fc4d-4ac5-aa63-062f65957d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:04.304314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0cc4d-fc4d-4ac5-aa63-062f65957d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:04.304578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0cc4d-fc4d-4ac5-aa63-062f65957d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:04.304915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0cc4d-fc4d-4ac5-aa63-062f65957d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:04.305747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0cc4d-fc4d-4ac5-aa63-062f65957d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:04.307991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0cc4d-fc4d-4ac5-aa63-062f65957d38 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:04.337108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 904/1823] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:04 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:04.343181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d1155-30d9-4322-90cd-155c28644358 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:04.366960 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d1155-30d9-4322-90cd-155c28644358 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:04.373818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4b77f-c898-4755-ac18-796360ae479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:04.374658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4b77f-c898-4755-ac18-796360ae479a admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:04.374961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4b77f-c898-4755-ac18-796360ae479a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:04.375430 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4b77f-c898-4755-ac18-796360ae479a admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:04.376059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4b77f-c898-4755-ac18-796360ae479a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:04.377805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4b77f-c898-4755-ac18-796360ae479a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:04.390732 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 920/1824] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:04.394704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0cc4d-fc4d-4ac5-aa63-062f65957d38 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:04.407034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0cc4d-fc4d-4ac5-aa63-062f65957d38 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:04.413657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2cbfd-5d38-45b6-9779-54e68993b36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:04.414175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2cbfd-5d38-45b6-9779-54e68993b36d admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:04.414457 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2cbfd-5d38-45b6-9779-54e68993b36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:04.414729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2cbfd-5d38-45b6-9779-54e68993b36d admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:04.415422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2cbfd-5d38-45b6-9779-54e68993b36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:04.417147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2cbfd-5d38-45b6-9779-54e68993b36d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:04.430910 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 905/1825] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:04.435479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4b77f-c898-4755-ac18-796360ae479a admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:04.451179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4b77f-c898-4755-ac18-796360ae479a admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:04.457987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1118e-8002-4ba6-a44f-26856dbc573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:04.458953 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1118e-8002-4ba6-a44f-26856dbc573b admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:04.459586 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1118e-8002-4ba6-a44f-26856dbc573b admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:04.459857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1118e-8002-4ba6-a44f-26856dbc573b admin admin] PATH_INFO: `/v3/projects/db756dc03a074803b8df040ccb76955e/users/71b879c99d1c4f0bbcaf7bffd64db18d/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:04.478982 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1118e-8002-4ba6-a44f-26856dbc573b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db756dc03a074803b8df040ccb76955e, user_id=71b879c99d1c4f0bbcaf7bffd64db18d, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:04.482021 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1118e-8002-4ba6-a44f-26856dbc573b admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:04.502512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 921/1826] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:04 2022] PUT /identity/v3/projects/db756dc03a074803b8df040ccb76955e/users/71b879c99d1c4f0bbcaf7bffd64db18d/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:04.513988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e8ee1-30cd-4f07-89ff-60fe51054995 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:04.514607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e8ee1-30cd-4f07-89ff-60fe51054995 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:04.515757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e8ee1-30cd-4f07-89ff-60fe51054995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:04.569488 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-d55e8ee1-30cd-4f07-89ff-60fe51054995 None None] MFA Rules not processed for user `71b879c99d1c4f0bbcaf7bffd64db18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:04.572928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d55e8ee1-30cd-4f07-89ff-60fe51054995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:04.656064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 906/1827] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:04.661129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1118e-8002-4ba6-a44f-26856dbc573b admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:04.742242 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1118e-8002-4ba6-a44f-26856dbc573b admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:04.747177 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1d6cc-c246-4868-9643-0e8d9108e4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:04.747737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1d6cc-c246-4868-9643-0e8d9108e4db admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:04.748017 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1d6cc-c246-4868-9643-0e8d9108e4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:04.748292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1d6cc-c246-4868-9643-0e8d9108e4db admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:04.748957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1d6cc-c246-4868-9643-0e8d9108e4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:04.750979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1d6cc-c246-4868-9643-0e8d9108e4db admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:04.779239 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 922/1828] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:04 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:04.783215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e8ee1-30cd-4f07-89ff-60fe51054995 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:04.794571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e8ee1-30cd-4f07-89ff-60fe51054995 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:04.840325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:04.859259 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd52d5-abfb-4b3f-b0a9-b2a51a055768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:04.859985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd52d5-abfb-4b3f-b0a9-b2a51a055768 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:04.860292 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd52d5-abfb-4b3f-b0a9-b2a51a055768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:04.860575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd52d5-abfb-4b3f-b0a9-b2a51a055768 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:04.861303 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd52d5-abfb-4b3f-b0a9-b2a51a055768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:04.863363 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd52d5-abfb-4b3f-b0a9-b2a51a055768 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:04.888399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 907/1829] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:04 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:04.889560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1d6cc-c246-4868-9643-0e8d9108e4db admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:04.900051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1d6cc-c246-4868-9643-0e8d9108e4db admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:04.904946 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bd3ad-12d4-403c-88d6-73e9a252cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:04.905568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bd3ad-12d4-403c-88d6-73e9a252cc18 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:04.905855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bd3ad-12d4-403c-88d6-73e9a252cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:04.906176 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bd3ad-12d4-403c-88d6-73e9a252cc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:04.906871 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bd3ad-12d4-403c-88d6-73e9a252cc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:04.908474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bd3ad-12d4-403c-88d6-73e9a252cc18 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:04.920137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 923/1830] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:04.924508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd52d5-abfb-4b3f-b0a9-b2a51a055768 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:04.934940 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd52d5-abfb-4b3f-b0a9-b2a51a055768 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:04.939517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d39f08-10c1-4fa4-ad76-d2549c4f7825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:04.940180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39f08-10c1-4fa4-ad76-d2549c4f7825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:04.940485 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39f08-10c1-4fa4-ad76-d2549c4f7825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:04.940747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39f08-10c1-4fa4-ad76-d2549c4f7825 admin admin] PATH_INFO: `/v3/projects/c8f522c62e0a4b2c80d0259ac7b0ca28/users/340d13dcdc56498fa7573b25b0e5b01f/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:04.955588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d39f08-10c1-4fa4-ad76-d2549c4f7825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f522c62e0a4b2c80d0259ac7b0ca28, user_id=340d13dcdc56498fa7573b25b0e5b01f, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:04.958268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d39f08-10c1-4fa4-ad76-d2549c4f7825 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:04.970830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 908/1831] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:04 2022] PUT /identity/v3/projects/c8f522c62e0a4b2c80d0259ac7b0ca28/users/340d13dcdc56498fa7573b25b0e5b01f/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:04.974918 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bd3ad-12d4-403c-88d6-73e9a252cc18 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:04.984959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bd3ad-12d4-403c-88d6-73e9a252cc18 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:05.040948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09d753-f2d2-41d0-9038-e637d65548be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:05.041499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09d753-f2d2-41d0-9038-e637d65548be admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:05.041784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09d753-f2d2-41d0-9038-e637d65548be admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:05.042091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09d753-f2d2-41d0-9038-e637d65548be admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:05.042788 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09d753-f2d2-41d0-9038-e637d65548be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:05.044524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09d753-f2d2-41d0-9038-e637d65548be admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:05.055562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 924/1832] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:05.059714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d39f08-10c1-4fa4-ad76-d2549c4f7825 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:05.070781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d39f08-10c1-4fa4-ad76-d2549c4f7825 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:05.075477 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b393f3-e851-41cb-804d-ef79da942ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:05.076144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b393f3-e851-41cb-804d-ef79da942ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:05.076435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b393f3-e851-41cb-804d-ef79da942ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:05.076715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b393f3-e851-41cb-804d-ef79da942ce6 admin admin] PATH_INFO: `/v3/projects/c8f522c62e0a4b2c80d0259ac7b0ca28/users/340d13dcdc56498fa7573b25b0e5b01f/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:05.078695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b393f3-e851-41cb-804d-ef79da942ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f522c62e0a4b2c80d0259ac7b0ca28, user_id=340d13dcdc56498fa7573b25b0e5b01f, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:05.081322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b393f3-e851-41cb-804d-ef79da942ce6 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:05.091643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 909/1833] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:05 2022] PUT /identity/v3/projects/c8f522c62e0a4b2c80d0259ac7b0ca28/users/340d13dcdc56498fa7573b25b0e5b01f/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:05.101822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f527-b867-42eb-bd3f-b44df6760ec3 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:05.102156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f527-b867-42eb-bd3f-b44df6760ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:05.102439 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f527-b867-42eb-bd3f-b44df6760ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:05.131940 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-4a23f527-b867-42eb-bd3f-b44df6760ec3 None None] MFA Rules not processed for user `340d13dcdc56498fa7573b25b0e5b01f`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:05.133165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4a23f527-b867-42eb-bd3f-b44df6760ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:05.150308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:05.212038 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 925/1834] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:05.224797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b393f3-e851-41cb-804d-ef79da942ce6 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:05.226766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-16b393f3-e851-41cb-804d-ef79da942ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:05.298797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b393f3-e851-41cb-804d-ef79da942ce6 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:05.304158 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c4a4b-5cbd-4c2e-a004-31833a9ee4bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:05.305083 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c4a4b-5cbd-4c2e-a004-31833a9ee4bf service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:05.305386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c4a4b-5cbd-4c2e-a004-31833a9ee4bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:05.305634 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c4a4b-5cbd-4c2e-a004-31833a9ee4bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:05.315499 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c4a4b-5cbd-4c2e-a004-31833a9ee4bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:05.316920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c4a4b-5cbd-4c2e-a004-31833a9ee4bf service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:05.328052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 910/1835] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:05.881817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23f527-b867-42eb-bd3f-b44df6760ec3 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:05.893661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23f527-b867-42eb-bd3f-b44df6760ec3 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:05.899469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b88b66-0516-4a3c-804f-a1486fbae867 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340d13dcdc56498fa7573b25b0e5b01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f522c62e0a4b2c80d0259ac7b0ca28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:05.900620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b88b66-0516-4a3c-804f-a1486fbae867 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:05.901083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b88b66-0516-4a3c-804f-a1486fbae867 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:05.901553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b88b66-0516-4a3c-804f-a1486fbae867 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:05.902461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b88b66-0516-4a3c-804f-a1486fbae867 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:05.903324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b88b66-0516-4a3c-804f-a1486fbae867 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:05.906694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b88b66-0516-4a3c-804f-a1486fbae867 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:05.930450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 926/1836] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:05.934964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c4a4b-5cbd-4c2e-a004-31833a9ee4bf service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:05.944377 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c4a4b-5cbd-4c2e-a004-31833a9ee4bf service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:05.949395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194b42d-9d51-490b-bc10-3a8aef282d85 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340d13dcdc56498fa7573b25b0e5b01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f522c62e0a4b2c80d0259ac7b0ca28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:05.950034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194b42d-9d51-490b-bc10-3a8aef282d85 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:05.950520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194b42d-9d51-490b-bc10-3a8aef282d85 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:05.951184 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194b42d-9d51-490b-bc10-3a8aef282d85 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:05.951678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194b42d-9d51-490b-bc10-3a8aef282d85 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:05.953581 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194b42d-9d51-490b-bc10-3a8aef282d85 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:05.982275 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 911/1837] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:05 2022] POST /identity/v3/projects => generated 353 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:05.986544 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b88b66-0516-4a3c-804f-a1486fbae867 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:06.003523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b88b66-0516-4a3c-804f-a1486fbae867 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:06.076125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858dbc3-4c8d-408b-9bab-7dda6495b321 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340d13dcdc56498fa7573b25b0e5b01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f522c62e0a4b2c80d0259ac7b0ca28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:06.076873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858dbc3-4c8d-408b-9bab-7dda6495b321 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:06.077336 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858dbc3-4c8d-408b-9bab-7dda6495b321 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:06.077628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858dbc3-4c8d-408b-9bab-7dda6495b321 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:06.078386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858dbc3-4c8d-408b-9bab-7dda6495b321 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:06.078950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858dbc3-4c8d-408b-9bab-7dda6495b321 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:06.080576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858dbc3-4c8d-408b-9bab-7dda6495b321 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:06.097279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 927/1838] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:06.165168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194b42d-9d51-490b-bc10-3a8aef282d85 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:06.179490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194b42d-9d51-490b-bc10-3a8aef282d85 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:06.184594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '340d13dcdc56498fa7573b25b0e5b01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8f522c62e0a4b2c80d0259ac7b0ca28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:06.185425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:06.185791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:06.186248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] PATH_INFO: `/v3/projects/8f630aadb69b42098ae1932524d05064` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:06.187616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8f630aadb69b42098ae1932524d05064)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:06.189831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:06.250263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f630aadb69b42098ae1932524d05064', 'request_id': 'req-319f803f-5c3a-419e-95b7-f3436a1985f7'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.262180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f630aadb69b42098ae1932524d05064', 'request_id': 'req-319f803f-5c3a-419e-95b7-f3436a1985f7'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.269673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f630aadb69b42098ae1932524d05064', 'request_id': 'req-319f803f-5c3a-419e-95b7-f3436a1985f7'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.286293 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:06.293827 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] The token cache is being invalidate because project 8f630aadb69b42098ae1932524d05064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:06.294421 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.295585 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.297843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 912/1839] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:06 2022] DELETE /identity/v3/projects/8f630aadb69b42098ae1932524d05064 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:06.566571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858dbc3-4c8d-408b-9bab-7dda6495b321 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:06.571575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f858dbc3-4c8d-408b-9bab-7dda6495b321 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:06.621745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:06.623205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:06.659590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858dbc3-4c8d-408b-9bab-7dda6495b321 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:06.699447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f803f-5c3a-419e-95b7-f3436a1985f7 tempest-VolumeQuotaClassesTest-465262217 tempest-VolumeQuotaClassesTest-465262217-project-admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:06.704432 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a4f54-d1d6-476b-86ca-79fd00271d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:06.705092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a4f54-d1d6-476b-86ca-79fd00271d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:06.705374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a4f54-d1d6-476b-86ca-79fd00271d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:06.705777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a4f54-d1d6-476b-86ca-79fd00271d4e admin admin] PATH_INFO: `/v3/users/71b879c99d1c4f0bbcaf7bffd64db18d` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:06.707010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a4f54-d1d6-476b-86ca-79fd00271d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b879c99d1c4f0bbcaf7bffd64db18d)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:06.709498 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a4f54-d1d6-476b-86ca-79fd00271d4e admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:06.710889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:06.729124 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26390947-896b-4938-b8ef-b38c02b16a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:06.729774 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26390947-896b-4938-b8ef-b38c02b16a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:06.730087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26390947-896b-4938-b8ef-b38c02b16a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:06.730369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26390947-896b-4938-b8ef-b38c02b16a0f admin admin] PATH_INFO: `/v3/users/4c894402c6c04b32b7b6a0fd67e713cd` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:06.731555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26390947-896b-4938-b8ef-b38c02b16a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c894402c6c04b32b7b6a0fd67e713cd)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:06.733565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26390947-896b-4938-b8ef-b38c02b16a0f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:06.759464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-d53a4f54-d1d6-476b-86ca-79fd00271d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b879c99d1c4f0bbcaf7bffd64db18d'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.760222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-d53a4f54-d1d6-476b-86ca-79fd00271d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b879c99d1c4f0bbcaf7bffd64db18d'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.776185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-d53a4f54-d1d6-476b-86ca-79fd00271d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b879c99d1c4f0bbcaf7bffd64db18d'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.781191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-26390947-896b-4938-b8ef-b38c02b16a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c894402c6c04b32b7b6a0fd67e713cd'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.788482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-26390947-896b-4938-b8ef-b38c02b16a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c894402c6c04b32b7b6a0fd67e713cd'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.789623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-d53a4f54-d1d6-476b-86ca-79fd00271d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b879c99d1c4f0bbcaf7bffd64db18d'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.790652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-d53a4f54-d1d6-476b-86ca-79fd00271d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b879c99d1c4f0bbcaf7bffd64db18d'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.795915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-26390947-896b-4938-b8ef-b38c02b16a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c894402c6c04b32b7b6a0fd67e713cd'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.796570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-26390947-896b-4938-b8ef-b38c02b16a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c894402c6c04b32b7b6a0fd67e713cd'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.804995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 913/1840] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:06 2022] DELETE /identity/v3/users/71b879c99d1c4f0bbcaf7bffd64db18d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:06.809413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b6b19-3704-431e-aa37-7c9a7b74f9fa None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:06.809704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b6b19-3704-431e-aa37-7c9a7b74f9fa None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:06.809836 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-26390947-896b-4938-b8ef-b38c02b16a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c894402c6c04b32b7b6a0fd67e713cd'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:06.809974 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b6b19-3704-431e-aa37-7c9a7b74f9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:06.816142 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 928/1841] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:06 2022] DELETE /identity/v3/users/4c894402c6c04b32b7b6a0fd67e713cd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:06.821085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddb446-b3fa-41ce-b996-83f1b35beb35 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:06.821376 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddb446-b3fa-41ce-b996-83f1b35beb35 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:06.821673 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddb446-b3fa-41ce-b996-83f1b35beb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:06.829564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-c84b6b19-3704-431e-aa37-7c9a7b74f9fa None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:06.830818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c84b6b19-3704-431e-aa37-7c9a7b74f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:06.840562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-94ddb446-b3fa-41ce-b996-83f1b35beb35 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:06.841739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-94ddb446-b3fa-41ce-b996-83f1b35beb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:06.911169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 914/1842] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:06.923830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 929/1843] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:06.955624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b6b19-3704-431e-aa37-7c9a7b74f9fa None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:06.957638 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c84b6b19-3704-431e-aa37-7c9a7b74f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:06.969868 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddb446-b3fa-41ce-b996-83f1b35beb35 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:06.971306 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-94ddb446-b3fa-41ce-b996-83f1b35beb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:07.050517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:07.115929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b6b19-3704-431e-aa37-7c9a7b74f9fa None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:07.117728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddb446-b3fa-41ce-b996-83f1b35beb35 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:07.123569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068048c-7a63-4d67-9d38-5e3d66e3c326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:07.124208 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068048c-7a63-4d67-9d38-5e3d66e3c326 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:07.124955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b79da3-76b7-490c-b6b8-fd5147ee62da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:07.125587 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b79da3-76b7-490c-b6b8-fd5147ee62da service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:07.125869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b79da3-76b7-490c-b6b8-fd5147ee62da service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:07.126169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b79da3-76b7-490c-b6b8-fd5147ee62da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:07.127026 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068048c-7a63-4d67-9d38-5e3d66e3c326 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:07.127316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068048c-7a63-4d67-9d38-5e3d66e3c326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:07.143214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068048c-7a63-4d67-9d38-5e3d66e3c326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:07.144857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068048c-7a63-4d67-9d38-5e3d66e3c326 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:07.147975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b79da3-76b7-490c-b6b8-fd5147ee62da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:07.149501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b79da3-76b7-490c-b6b8-fd5147ee62da service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:07.157148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 930/1844] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:07.161286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 915/1845] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:07.582945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068048c-7a63-4d67-9d38-5e3d66e3c326 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:07.585060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7068048c-7a63-4d67-9d38-5e3d66e3c326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:07.589746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b79da3-76b7-490c-b6b8-fd5147ee62da service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:07.591245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b8b79da3-76b7-490c-b6b8-fd5147ee62da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:07.613450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:07.619619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068048c-7a63-4d67-9d38-5e3d66e3c326 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:07.623293 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b79da3-76b7-490c-b6b8-fd5147ee62da service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:07.626112 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:07.627694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:07.628446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:07.629347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] PATH_INFO: `/v3/projects/db756dc03a074803b8df040ccb76955e` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:07.631692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db756dc03a074803b8df040ccb76955e)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:07.634224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:07.636515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:07.639854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:07.639854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:07.639854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] PATH_INFO: `/v3/projects/d761f628a5284d1b8f2fb0c6394b4669` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:07.644398 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d761f628a5284d1b8f2fb0c6394b4669)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:07.649278 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:07.715188 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db756dc03a074803b8df040ccb76955e', 'request_id': 'req-9baf3f8d-ca11-48ef-bd17-4c695458f20d'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.729442 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db756dc03a074803b8df040ccb76955e', 'request_id': 'req-9baf3f8d-ca11-48ef-bd17-4c695458f20d'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.741527 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db756dc03a074803b8df040ccb76955e', 'request_id': 'req-9baf3f8d-ca11-48ef-bd17-4c695458f20d'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.750431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd761f628a5284d1b8f2fb0c6394b4669', 'request_id': 'req-e11d3ecd-6718-425c-af0d-555bfb61cafc'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.760269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd761f628a5284d1b8f2fb0c6394b4669', 'request_id': 'req-e11d3ecd-6718-425c-af0d-555bfb61cafc'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.768156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] The token cache is being invalidate because project db756dc03a074803b8df040ccb76955e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:07.768457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.771596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.775667 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 931/1846] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:07 2022] DELETE /identity/v3/projects/db756dc03a074803b8df040ccb76955e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:07.781884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:07.783343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:07.787461 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd761f628a5284d1b8f2fb0c6394b4669', 'request_id': 'req-e11d3ecd-6718-425c-af0d-555bfb61cafc'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.804665 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] The token cache is being invalidate because project d761f628a5284d1b8f2fb0c6394b4669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:07.805006 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.805600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.807189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 916/1847] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:07 2022] DELETE /identity/v3/projects/d761f628a5284d1b8f2fb0c6394b4669 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:07.810883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:07.814805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:07.857751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf3f8d-ca11-48ef-bd17-4c695458f20d admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:07.902883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d3ecd-6718-425c-af0d-555bfb61cafc admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:07.909143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:07.909870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:07.910247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:07.910590 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] PATH_INFO: `/v3/users/0795758d72a3468295d72637c6d68271` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:07.912576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0795758d72a3468295d72637c6d68271)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:07.914980 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:07.934224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477af66c-55ee-4312-8ca9-f6f3bab08945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:07.934224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477af66c-55ee-4312-8ca9-f6f3bab08945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:07.934224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477af66c-55ee-4312-8ca9-f6f3bab08945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:07.934224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477af66c-55ee-4312-8ca9-f6f3bab08945 admin admin] PATH_INFO: `/v3/users/340d13dcdc56498fa7573b25b0e5b01f` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:07.934948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477af66c-55ee-4312-8ca9-f6f3bab08945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=340d13dcdc56498fa7573b25b0e5b01f)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:07.934948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477af66c-55ee-4312-8ca9-f6f3bab08945 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:07.967411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:07.969744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0795758d72a3468295d72637c6d68271'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.971429 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0795758d72a3468295d72637c6d68271'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.979448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:07.988906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-477af66c-55ee-4312-8ca9-f6f3bab08945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '340d13dcdc56498fa7573b25b0e5b01f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.989604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0795758d72a3468295d72637c6d68271'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:07.999463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-477af66c-55ee-4312-8ca9-f6f3bab08945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '340d13dcdc56498fa7573b25b0e5b01f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.005303 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0795758d72a3468295d72637c6d68271'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.006308 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0795758d72a3468295d72637c6d68271'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.008695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-477af66c-55ee-4312-8ca9-f6f3bab08945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '340d13dcdc56498fa7573b25b0e5b01f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.009818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-477af66c-55ee-4312-8ca9-f6f3bab08945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '340d13dcdc56498fa7573b25b0e5b01f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.021610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 917/1848] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:07 2022] DELETE /identity/v3/users/0795758d72a3468295d72637c6d68271 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:08.022843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:08.024815 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:08.030899 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-477af66c-55ee-4312-8ca9-f6f3bab08945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '340d13dcdc56498fa7573b25b0e5b01f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.038618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 932/1849] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:07 2022] DELETE /identity/v3/users/340d13dcdc56498fa7573b25b0e5b01f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:08.043136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc03fe-eb16-4190-86be-838811022878 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:08.043601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc03fe-eb16-4190-86be-838811022878 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:08.044008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc03fe-eb16-4190-86be-838811022878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:08.065491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-87bc03fe-eb16-4190-86be-838811022878 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:08.066720 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-87bc03fe-eb16-4190-86be-838811022878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:08.116818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41573de-0fa4-43b4-8905-0773be43eefc admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:08.143630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 933/1850] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:08.156370 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc03fe-eb16-4190-86be-838811022878 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:08.158540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-87bc03fe-eb16-4190-86be-838811022878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:08.225251 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc124757-f752-4fd0-8d8e-7ac0db5d815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:08.225968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124757-f752-4fd0-8d8e-7ac0db5d815c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:08.226419 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124757-f752-4fd0-8d8e-7ac0db5d815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:08.226706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc124757-f752-4fd0-8d8e-7ac0db5d815c admin admin] PATH_INFO: `/v3/users/5dcf59085b054d4f9490516494882804` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:08.228516 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc124757-f752-4fd0-8d8e-7ac0db5d815c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dcf59085b054d4f9490516494882804)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:08.230955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc124757-f752-4fd0-8d8e-7ac0db5d815c admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:08.258775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc03fe-eb16-4190-86be-838811022878 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:08.263598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b217f3d-d728-414a-9d6f-b50286dae3e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:08.264370 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b217f3d-d728-414a-9d6f-b50286dae3e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:08.265780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b217f3d-d728-414a-9d6f-b50286dae3e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:08.266354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b217f3d-d728-414a-9d6f-b50286dae3e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:08.281437 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b217f3d-d728-414a-9d6f-b50286dae3e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:08.283191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b217f3d-d728-414a-9d6f-b50286dae3e1 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:08.299201 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 934/1851] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:08.308533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-cc124757-f752-4fd0-8d8e-7ac0db5d815c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dcf59085b054d4f9490516494882804'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.309445 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-cc124757-f752-4fd0-8d8e-7ac0db5d815c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dcf59085b054d4f9490516494882804'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.319463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-cc124757-f752-4fd0-8d8e-7ac0db5d815c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dcf59085b054d4f9490516494882804'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.334238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-cc124757-f752-4fd0-8d8e-7ac0db5d815c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dcf59085b054d4f9490516494882804'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.335121 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-cc124757-f752-4fd0-8d8e-7ac0db5d815c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dcf59085b054d4f9490516494882804'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.336576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:08.366720 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 918/1852] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:08 2022] DELETE /identity/v3/users/5dcf59085b054d4f9490516494882804 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:08.451320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b217f3d-d728-414a-9d6f-b50286dae3e1 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:08.452849 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4b217f3d-d728-414a-9d6f-b50286dae3e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:08.467449 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b217f3d-d728-414a-9d6f-b50286dae3e1 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:08.529093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:08.536311 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:08.537914 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:08.538725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:08.539102 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] PATH_INFO: `/v3/projects/c8f522c62e0a4b2c80d0259ac7b0ca28` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:08.540342 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f522c62e0a4b2c80d0259ac7b0ca28)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:08.542703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:08.619097 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f522c62e0a4b2c80d0259ac7b0ca28', 'request_id': 'req-61fa6464-fe42-4052-a4bb-456f6435a3cf'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.626155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f522c62e0a4b2c80d0259ac7b0ca28', 'request_id': 'req-61fa6464-fe42-4052-a4bb-456f6435a3cf'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.633858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f522c62e0a4b2c80d0259ac7b0ca28', 'request_id': 'req-61fa6464-fe42-4052-a4bb-456f6435a3cf'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.668428 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] The token cache is being invalidate because project c8f522c62e0a4b2c80d0259ac7b0ca28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:08.668741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.669913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:08.675038 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 935/1853] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:08 2022] DELETE /identity/v3/projects/c8f522c62e0a4b2c80d0259ac7b0ca28 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:08.677677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58924c2e-7edb-4da7-b466-a3a99eaa50c1 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:08.678282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58924c2e-7edb-4da7-b466-a3a99eaa50c1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:08.678282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58924c2e-7edb-4da7-b466-a3a99eaa50c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:08.743803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-58924c2e-7edb-4da7-b466-a3a99eaa50c1 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:08.745227 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-58924c2e-7edb-4da7-b466-a3a99eaa50c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:08.797214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:08.798915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:08.889237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 919/1854] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:08.898707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e183c-3206-4374-aa06-09b1839c9283 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:08.898995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e183c-3206-4374-aa06-09b1839c9283 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:08.899272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e183c-3206-4374-aa06-09b1839c9283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:08.920892 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa6464-fe42-4052-a4bb-456f6435a3cf admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:08.923571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-613e183c-3206-4374-aa06-09b1839c9283 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:08.925011 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-613e183c-3206-4374-aa06-09b1839c9283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:08.930605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:08.932110 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:08.932900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:08.933443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] PATH_INFO: `/v3/projects/9a9fbd97057646449b280e76988e3e46` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:08.935723 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9fbd97057646449b280e76988e3e46)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:08.938799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:08.941822 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 920/1855] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:08.943047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e183c-3206-4374-aa06-09b1839c9283 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:08.955824 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e183c-3206-4374-aa06-09b1839c9283 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:08.985782 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908289f6-dbfd-404a-a460-09a2b63311f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:08.988862 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908289f6-dbfd-404a-a460-09a2b63311f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:08.989346 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908289f6-dbfd-404a-a460-09a2b63311f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:08.991107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908289f6-dbfd-404a-a460-09a2b63311f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:08.993278 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908289f6-dbfd-404a-a460-09a2b63311f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:08.993627 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908289f6-dbfd-404a-a460-09a2b63311f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:08.996870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908289f6-dbfd-404a-a460-09a2b63311f7 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:09.037190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9fbd97057646449b280e76988e3e46', 'request_id': 'req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:09.041427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 921/1856] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:09.046891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9fbd97057646449b280e76988e3e46', 'request_id': 'req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:09.054234 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908289f6-dbfd-404a-a460-09a2b63311f7 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:09.057674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9fbd97057646449b280e76988e3e46', 'request_id': 'req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:09.083292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] The token cache is being invalidate because project 9a9fbd97057646449b280e76988e3e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:09.084251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:09.085196 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:09.092553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 936/1857] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:08 2022] DELETE /identity/v3/projects/9a9fbd97057646449b280e76988e3e46 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:09.094266 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:09.097718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:09.105711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908289f6-dbfd-404a-a460-09a2b63311f7 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:09.156971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:09.260683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b6720-b7ce-4cd5-8676-ff9dd5903e4a admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:09.263184 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7f62-fd82-447b-b90c-284868018b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:09.267262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7f62-fd82-447b-b90c-284868018b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:09.267586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7f62-fd82-447b-b90c-284868018b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:09.267874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a7f62-fd82-447b-b90c-284868018b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:09.268594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a7f62-fd82-447b-b90c-284868018b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:09.272782 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:09.274960 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:09.276140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:09.276554 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] PATH_INFO: `/v3/users/2f48088251a1481bab463028a11fa801` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:09.277764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a7f62-fd82-447b-b90c-284868018b0a admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:09.279797 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f48088251a1481bab463028a11fa801)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:09.284456 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:09.347508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 922/1858] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:09 2022] POST /identity/v3/projects => generated 383 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:09.366123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7f62-fd82-447b-b90c-284868018b0a admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:09.368170 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8c8a7f62-fd82-447b-b90c-284868018b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:09.399158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f48088251a1481bab463028a11fa801'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:09.414357 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f48088251a1481bab463028a11fa801'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:09.425224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f48088251a1481bab463028a11fa801'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:09.425969 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f48088251a1481bab463028a11fa801'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:09.497474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f48088251a1481bab463028a11fa801'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:09.509116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:09.525979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a7f62-fd82-447b-b90c-284868018b0a admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:09.528990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 937/1859] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:09 2022] DELETE /identity/v3/users/2f48088251a1481bab463028a11fa801 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:09.658431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db07064-6419-4f84-8fc4-d8eeaf7fc718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:09.659055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db07064-6419-4f84-8fc4-d8eeaf7fc718 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:09.659810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db07064-6419-4f84-8fc4-d8eeaf7fc718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:09.660656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db07064-6419-4f84-8fc4-d8eeaf7fc718 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:09.662762 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db07064-6419-4f84-8fc4-d8eeaf7fc718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:09.667634 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db07064-6419-4f84-8fc4-d8eeaf7fc718 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:09.701114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 923/1860] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:09 2022] POST /identity/v3/users => generated 292 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:09.702513 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:09.704012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:09.719504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaf5d5-20f7-4be8-9e63-ef5127f7bcda admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:09.724694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10e548-bfc7-4fbf-b5c8-c3cc9622e9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:09.725422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10e548-bfc7-4fbf-b5c8-c3cc9622e9fd admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:09.725783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10e548-bfc7-4fbf-b5c8-c3cc9622e9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:09.726186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10e548-bfc7-4fbf-b5c8-c3cc9622e9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:09.726984 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10e548-bfc7-4fbf-b5c8-c3cc9622e9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:09.728680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10e548-bfc7-4fbf-b5c8-c3cc9622e9fd admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:09.741519 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 938/1861] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:09.745544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db07064-6419-4f84-8fc4-d8eeaf7fc718 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:09.762222 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db07064-6419-4f84-8fc4-d8eeaf7fc718 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:09.767919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fbbaa-1941-449f-b084-1df2f3988b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:09.768701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fbbaa-1941-449f-b084-1df2f3988b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:09.769056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fbbaa-1941-449f-b084-1df2f3988b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:09.769401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fbbaa-1941-449f-b084-1df2f3988b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:09.770239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fbbaa-1941-449f-b084-1df2f3988b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:09.772545 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fbbaa-1941-449f-b084-1df2f3988b42 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:09.784594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 924/1862] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:09.789186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10e548-bfc7-4fbf-b5c8-c3cc9622e9fd admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:09.799530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10e548-bfc7-4fbf-b5c8-c3cc9622e9fd admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:09.805007 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5eadc3-c089-4dff-84b2-a769e895a151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:09.805702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eadc3-c089-4dff-84b2-a769e895a151 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:09.805986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eadc3-c089-4dff-84b2-a769e895a151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:09.806316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5eadc3-c089-4dff-84b2-a769e895a151 admin admin] PATH_INFO: `/v3/projects/4157d2ed36b34ae7ae6cc735cfedd1cf/users/ee3fd493bc954b8b9a462cab808a1b85/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:09.822803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5eadc3-c089-4dff-84b2-a769e895a151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4157d2ed36b34ae7ae6cc735cfedd1cf, user_id=ee3fd493bc954b8b9a462cab808a1b85, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:09.825954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb62d1-d55b-49f3-96a3-b9a67e29c000 None None] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:09.826511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb62d1-d55b-49f3-96a3-b9a67e29c000 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:09.826511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb62d1-d55b-49f3-96a3-b9a67e29c000 None None] PATH_INFO: `/` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:09.828181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 925/1863] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 08:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 08:24:09.829268 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5eadc3-c089-4dff-84b2-a769e895a151 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:09.843941 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac02bd-ecb8-4bd2-b0ba-6f01752038b4 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:09.844746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac02bd-ecb8-4bd2-b0ba-6f01752038b4 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:09.845576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac02bd-ecb8-4bd2-b0ba-6f01752038b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:09.854539 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 939/1864] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:09 2022] PUT /identity/v3/projects/4157d2ed36b34ae7ae6cc735cfedd1cf/users/ee3fd493bc954b8b9a462cab808a1b85/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:09.855991 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e13e5-55f1-4d2d-bba2-0841eb8ceeb2 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:09.856279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e13e5-55f1-4d2d-bba2-0841eb8ceeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:09.856553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e13e5-55f1-4d2d-bba2-0841eb8ceeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:09.889655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-bfac02bd-ecb8-4bd2-b0ba-6f01752038b4 None None] MFA Rules not processed for user `93143507a8784a30bc6b4a5e1f24f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:09.892179 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-bfac02bd-ecb8-4bd2-b0ba-6f01752038b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:09.894305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-440e13e5-55f1-4d2d-bba2-0841eb8ceeb2 None None] MFA Rules not processed for user `ee3fd493bc954b8b9a462cab808a1b85`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:09.896772 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-440e13e5-55f1-4d2d-bba2-0841eb8ceeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:09.964851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:09.993287 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 940/1865] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:09.997744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 926/1866] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 08:24:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:09.999085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e13e5-55f1-4d2d-bba2-0841eb8ceeb2 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:10.011238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac02bd-ecb8-4bd2-b0ba-6f01752038b4 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:10.013515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-bfac02bd-ecb8-4bd2-b0ba-6f01752038b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:10.028173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac02bd-ecb8-4bd2-b0ba-6f01752038b4 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:10.035582 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633b53d-9103-471f-bda7-d0e74939c237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:10.036220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b53d-9103-471f-bda7-d0e74939c237 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.037015 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b53d-9103-471f-bda7-d0e74939c237 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.037292 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633b53d-9103-471f-bda7-d0e74939c237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.051169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633b53d-9103-471f-bda7-d0e74939c237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:10.053738 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633b53d-9103-471f-bda7-d0e74939c237 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:10.070103 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 927/1867] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:10.091545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e13e5-55f1-4d2d-bba2-0841eb8ceeb2 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:10.095253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144ea5-b199-4792-9e35-1a1c0287cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:10.095709 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144ea5-b199-4792-9e35-1a1c0287cb94 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.095993 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144ea5-b199-4792-9e35-1a1c0287cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.096264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6144ea5-b199-4792-9e35-1a1c0287cb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.096995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6144ea5-b199-4792-9e35-1a1c0287cb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:10.099896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6144ea5-b199-4792-9e35-1a1c0287cb94 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:10.133298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 941/1868] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:09 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:10.137430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633b53d-9103-471f-bda7-d0e74939c237 service nova] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:10.138579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144ea5-b199-4792-9e35-1a1c0287cb94 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:10.140600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c6144ea5-b199-4792-9e35-1a1c0287cb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:10.149787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633b53d-9103-471f-bda7-d0e74939c237 service nova] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:10.232876 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6144ea5-b199-4792-9e35-1a1c0287cb94 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:10.234345 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2132c-f7b4-443b-8247-e70889135a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:10.234947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2132c-f7b4-443b-8247-e70889135a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.235296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2132c-f7b4-443b-8247-e70889135a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.235848 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2132c-f7b4-443b-8247-e70889135a58 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.236370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2132c-f7b4-443b-8247-e70889135a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:10.238401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2132c-f7b4-443b-8247-e70889135a58 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:10.238824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:10.239477 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.240490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.240825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] PATH_INFO: `/v3/projects/faa99884a2a34f93ac40c00fedb3b00c` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.242362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa99884a2a34f93ac40c00fedb3b00c)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:10.244034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:10.247682 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:10.278624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 928/1869] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:10 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:10.282829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2132c-f7b4-443b-8247-e70889135a58 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:10.296576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2132c-f7b4-443b-8247-e70889135a58 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:10.304077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4289a70-d983-4407-8158-c09e33b53c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:10.304992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4289a70-d983-4407-8158-c09e33b53c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.305512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4289a70-d983-4407-8158-c09e33b53c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.305973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4289a70-d983-4407-8158-c09e33b53c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.307029 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4289a70-d983-4407-8158-c09e33b53c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:10.309079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4289a70-d983-4407-8158-c09e33b53c60 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:10.324200 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 929/1870] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:10.328280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4289a70-d983-4407-8158-c09e33b53c60 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:10.339111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa99884a2a34f93ac40c00fedb3b00c', 'request_id': 'req-de8fb6c5-0d65-4d33-807d-e064e76485b3'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:10.346555 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4289a70-d983-4407-8158-c09e33b53c60 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:10.346821 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa99884a2a34f93ac40c00fedb3b00c', 'request_id': 'req-de8fb6c5-0d65-4d33-807d-e064e76485b3'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:10.357668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa99884a2a34f93ac40c00fedb3b00c', 'request_id': 'req-de8fb6c5-0d65-4d33-807d-e064e76485b3'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:10.376230 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] The token cache is being invalidate because project faa99884a2a34f93ac40c00fedb3b00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:10.376571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:10.377252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-de8fb6c5-0d65-4d33-807d-e064e76485b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:10.379619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 942/1871] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:10 2022] DELETE /identity/v3/projects/faa99884a2a34f93ac40c00fedb3b00c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:10.386528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188101be-db14-475f-b48c-14bb9c97ec24 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.387495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188101be-db14-475f-b48c-14bb9c97ec24 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.388998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188101be-db14-475f-b48c-14bb9c97ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.411309 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:10.414215 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-188101be-db14-475f-b48c-14bb9c97ec24 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:10.416618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-188101be-db14-475f-b48c-14bb9c97ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:10.439490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf8640-f764-4f22-8419-0a6493cdbf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:10.440192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8640-f764-4f22-8419-0a6493cdbf3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.440485 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8640-f764-4f22-8419-0a6493cdbf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.440766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf8640-f764-4f22-8419-0a6493cdbf3d admin admin] PATH_INFO: `/v3/projects/ac5668786df647929be2ec2c1ceebb52/users/7f756609bda94fa2aae9dd73141e0252/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.459683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf8640-f764-4f22-8419-0a6493cdbf3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5668786df647929be2ec2c1ceebb52, user_id=7f756609bda94fa2aae9dd73141e0252, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:10.462379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf8640-f764-4f22-8419-0a6493cdbf3d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:10.478659 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 930/1872] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:10 2022] PUT /identity/v3/projects/ac5668786df647929be2ec2c1ceebb52/users/7f756609bda94fa2aae9dd73141e0252/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:10.482262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf8640-f764-4f22-8419-0a6493cdbf3d admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:10.484028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-11bf8640-f764-4f22-8419-0a6493cdbf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:10.508908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 943/1873] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:10.510321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188101be-db14-475f-b48c-14bb9c97ec24 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:10.511612 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-188101be-db14-475f-b48c-14bb9c97ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:10.531422 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188101be-db14-475f-b48c-14bb9c97ec24 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:10.586438 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf8640-f764-4f22-8419-0a6493cdbf3d admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:10.595715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:10.598241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.598536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.598813 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] PATH_INFO: `/v3/projects/13ce24e3840e4f2d8513ea22ccf2ca33` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.601149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ce24e3840e4f2d8513ea22ccf2ca33)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:10.604509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:10.629817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd91085-7f45-4437-abff-29a884a6c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:10.631020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd91085-7f45-4437-abff-29a884a6c5cb admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.631326 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd91085-7f45-4437-abff-29a884a6c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.631754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd91085-7f45-4437-abff-29a884a6c5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.632480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd91085-7f45-4437-abff-29a884a6c5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:10.634565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd91085-7f45-4437-abff-29a884a6c5cb admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:10.657308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 944/1874] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:10.658810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177209-a528-4cfb-85cc-393fa350113d None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.659097 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177209-a528-4cfb-85cc-393fa350113d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.659381 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1177209-a528-4cfb-85cc-393fa350113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.668417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ce24e3840e4f2d8513ea22ccf2ca33', 'request_id': 'req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:10.675278 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ce24e3840e4f2d8513ea22ccf2ca33', 'request_id': 'req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:10.682039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ce24e3840e4f2d8513ea22ccf2ca33', 'request_id': 'req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:10.683872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:INSERT=4,keystone:SELECT=90,keystone:DELETE=6 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:10.685764 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d1177209-a528-4cfb-85cc-393fa350113d None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:10.687383 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d1177209-a528-4cfb-85cc-393fa350113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:10.700654 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] The token cache is being invalidate because project 13ce24e3840e4f2d8513ea22ccf2ca33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:10.701077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:10.702051 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:10.704292 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 931/1875] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:10 2022] DELETE /identity/v3/projects/13ce24e3840e4f2d8513ea22ccf2ca33 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:10.705375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:10.707966 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:10.808418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3aae8-c2ab-46aa-9cb7-1d870b3b8332 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:10.813233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b47c9e-29f4-4567-b76f-4b3e6ff07d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:10.813482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 945/1876] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:10.814087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b47c9e-29f4-4567-b76f-4b3e6ff07d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.814575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b47c9e-29f4-4567-b76f-4b3e6ff07d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.814778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228faca-5d9f-4a75-9d13-9175cc4ecc19 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.814969 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b47c9e-29f4-4567-b76f-4b3e6ff07d7d admin admin] PATH_INFO: `/v3/projects/ac5668786df647929be2ec2c1ceebb52/users/7f756609bda94fa2aae9dd73141e0252/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.815079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228faca-5d9f-4a75-9d13-9175cc4ecc19 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.815327 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228faca-5d9f-4a75-9d13-9175cc4ecc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.817520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b47c9e-29f4-4567-b76f-4b3e6ff07d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5668786df647929be2ec2c1ceebb52, user_id=7f756609bda94fa2aae9dd73141e0252, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:10.820611 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b47c9e-29f4-4567-b76f-4b3e6ff07d7d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:10.831893 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 932/1877] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:10 2022] PUT /identity/v3/projects/ac5668786df647929be2ec2c1ceebb52/users/7f756609bda94fa2aae9dd73141e0252/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:10.832713 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b47c9e-29f4-4567-b76f-4b3e6ff07d7d admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:10.836148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d228faca-5d9f-4a75-9d13-9175cc4ecc19 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:10.837559 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d228faca-5d9f-4a75-9d13-9175cc4ecc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:10.879050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:10.898450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 946/1878] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:10.899759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1fa2d-cdc0-4163-90c5-ac12294dd723 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.899865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b47c9e-29f4-4567-b76f-4b3e6ff07d7d admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:10.900038 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1fa2d-cdc0-4163-90c5-ac12294dd723 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.900330 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1fa2d-cdc0-4163-90c5-ac12294dd723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.908971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3561d-0be5-4aa6-b918-d798d52e10aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:10.909598 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3561d-0be5-4aa6-b918-d798d52e10aa admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.909882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3561d-0be5-4aa6-b918-d798d52e10aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.910201 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3561d-0be5-4aa6-b918-d798d52e10aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.910907 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3561d-0be5-4aa6-b918-d798d52e10aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:10.911216 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3561d-0be5-4aa6-b918-d798d52e10aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:10.913536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3561d-0be5-4aa6-b918-d798d52e10aa admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:10.925588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 933/1879] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:10.929295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda79867-f37e-4bb6-bbb7-1bf3e33c1d94 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.929295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda79867-f37e-4bb6-bbb7-1bf3e33c1d94 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.929295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda79867-f37e-4bb6-bbb7-1bf3e33c1d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.929576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-bdb1fa2d-cdc0-4163-90c5-ac12294dd723 None None] MFA Rules not processed for user `7f756609bda94fa2aae9dd73141e0252`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:10.930148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bdb1fa2d-cdc0-4163-90c5-ac12294dd723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:10.947256 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-eda79867-f37e-4bb6-bbb7-1bf3e33c1d94 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:10.948446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-eda79867-f37e-4bb6-bbb7-1bf3e33c1d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:10.956787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 934/1880] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:10.957450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda79867-f37e-4bb6-bbb7-1bf3e33c1d94 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:10.970450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda79867-f37e-4bb6-bbb7-1bf3e33c1d94 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:10.975936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b12c35-554c-4576-b7d6-d3e1004c6106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:10.976570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b12c35-554c-4576-b7d6-d3e1004c6106 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:10.976855 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b12c35-554c-4576-b7d6-d3e1004c6106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:10.977164 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b12c35-554c-4576-b7d6-d3e1004c6106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:10.977850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b12c35-554c-4576-b7d6-d3e1004c6106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:10.979834 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b12c35-554c-4576-b7d6-d3e1004c6106 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.011530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 947/1881] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:11.012197 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 935/1882] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:10 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:11.012729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b12c35-554c-4576-b7d6-d3e1004c6106 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.016346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1fa2d-cdc0-4163-90c5-ac12294dd723 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.028181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1fa2d-cdc0-4163-90c5-ac12294dd723 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.079536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:11.092834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28173e-1bed-421a-8619-f662b2488612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.093316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b12c35-554c-4576-b7d6-d3e1004c6106 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.093461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28173e-1bed-421a-8619-f662b2488612 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.093745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28173e-1bed-421a-8619-f662b2488612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.094046 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28173e-1bed-421a-8619-f662b2488612 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.094713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28173e-1bed-421a-8619-f662b2488612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.096660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28173e-1bed-421a-8619-f662b2488612 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.098420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db65329-48e2-4796-87a7-b0293af6a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.099637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db65329-48e2-4796-87a7-b0293af6a2ec admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.099881 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db65329-48e2-4796-87a7-b0293af6a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.100158 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db65329-48e2-4796-87a7-b0293af6a2ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.100845 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db65329-48e2-4796-87a7-b0293af6a2ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:11.101180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db65329-48e2-4796-87a7-b0293af6a2ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.102777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db65329-48e2-4796-87a7-b0293af6a2ec admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.117859 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 936/1883] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:11.117859 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db65329-48e2-4796-87a7-b0293af6a2ec admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.119319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4db65329-48e2-4796-87a7-b0293af6a2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:11.126321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 948/1884] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:11 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:11.126321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28173e-1bed-421a-8619-f662b2488612 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.138721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28173e-1bed-421a-8619-f662b2488612 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.144008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386af16a-2ca0-4378-a7c1-32859f0dee22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.144627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af16a-2ca0-4378-a7c1-32859f0dee22 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.144907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af16a-2ca0-4378-a7c1-32859f0dee22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.145238 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af16a-2ca0-4378-a7c1-32859f0dee22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.146407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386af16a-2ca0-4378-a7c1-32859f0dee22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.148324 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386af16a-2ca0-4378-a7c1-32859f0dee22 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.182837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 949/1885] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:11 2022] POST /identity/v3/projects => generated 401 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:11.182837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386af16a-2ca0-4378-a7c1-32859f0dee22 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.193888 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db65329-48e2-4796-87a7-b0293af6a2ec admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.230186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:11.260300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386af16a-2ca0-4378-a7c1-32859f0dee22 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.266209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed39cab-5896-44e9-a2c9-453075023274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.266377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed39cab-5896-44e9-a2c9-453075023274 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.266599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed39cab-5896-44e9-a2c9-453075023274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.267027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed39cab-5896-44e9-a2c9-453075023274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.267634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed39cab-5896-44e9-a2c9-453075023274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.269694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed39cab-5896-44e9-a2c9-453075023274 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.282506 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 950/1886] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:11.283314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed39cab-5896-44e9-a2c9-453075023274 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.293826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6924e-d0c3-495f-a6e2-f2ac505e865b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.294257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed39cab-5896-44e9-a2c9-453075023274 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.294523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6924e-d0c3-495f-a6e2-f2ac505e865b service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.294786 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6924e-d0c3-495f-a6e2-f2ac505e865b service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.295888 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6924e-d0c3-495f-a6e2-f2ac505e865b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.299623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b6217-c36c-49b7-ab40-6d8d816ce2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.300534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b6217-c36c-49b7-ab40-6d8d816ce2eb admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.300820 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b6217-c36c-49b7-ab40-6d8d816ce2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.301142 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b6217-c36c-49b7-ab40-6d8d816ce2eb admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.301752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b6217-c36c-49b7-ab40-6d8d816ce2eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.303787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b6217-c36c-49b7-ab40-6d8d816ce2eb admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.343483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 951/1887] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:11 2022] POST /identity/v3/users => generated 301 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:11.343483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b6217-c36c-49b7-ab40-6d8d816ce2eb admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.357976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b6217-c36c-49b7-ab40-6d8d816ce2eb admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.363325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ea408-5a64-4020-a74b-8f3ffa521663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.364107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea408-5a64-4020-a74b-8f3ffa521663 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.364398 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea408-5a64-4020-a74b-8f3ffa521663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.365296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea408-5a64-4020-a74b-8f3ffa521663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.366179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ea408-5a64-4020-a74b-8f3ffa521663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.367784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ea408-5a64-4020-a74b-8f3ffa521663 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.379093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 952/1888] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:11.379834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ea408-5a64-4020-a74b-8f3ffa521663 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.392493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6924e-d0c3-495f-a6e2-f2ac505e865b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.394168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6924e-d0c3-495f-a6e2-f2ac505e865b service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.394385 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ea408-5a64-4020-a74b-8f3ffa521663 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.400012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5e1cc-1f58-4c5b-9ca4-d54091f668f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.400639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5e1cc-1f58-4c5b-9ca4-d54091f668f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.400925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5e1cc-1f58-4c5b-9ca4-d54091f668f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.401201 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5e1cc-1f58-4c5b-9ca4-d54091f668f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.402522 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5e1cc-1f58-4c5b-9ca4-d54091f668f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.404364 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5e1cc-1f58-4c5b-9ca4-d54091f668f4 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.405494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 937/1889] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:11.406332 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6924e-d0c3-495f-a6e2-f2ac505e865b service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.416261 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 953/1890] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:11.416872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6924e-d0c3-495f-a6e2-f2ac505e865b service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.420156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5e1cc-1f58-4c5b-9ca4-d54091f668f4 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.423171 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed121e6-dcd7-4752-b7ae-839d02dfdf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.424081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed121e6-dcd7-4752-b7ae-839d02dfdf04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.424497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed121e6-dcd7-4752-b7ae-839d02dfdf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.424927 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed121e6-dcd7-4752-b7ae-839d02dfdf04 admin admin] PATH_INFO: `/v3/projects/c90e5260ee264f86ab7d314b2e364001/users/6f0f6777ac8b49af9156b43a22359ad8/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.430585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5e1cc-1f58-4c5b-9ca4-d54091f668f4 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.435970 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b14a81-2a31-4b38-8a89-2be85943585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.436680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b14a81-2a31-4b38-8a89-2be85943585f admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.436948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b14a81-2a31-4b38-8a89-2be85943585f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.437322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b14a81-2a31-4b38-8a89-2be85943585f admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.438118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b14a81-2a31-4b38-8a89-2be85943585f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.439785 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b14a81-2a31-4b38-8a89-2be85943585f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.443513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed121e6-dcd7-4752-b7ae-839d02dfdf04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90e5260ee264f86ab7d314b2e364001, user_id=6f0f6777ac8b49af9156b43a22359ad8, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.447279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed121e6-dcd7-4752-b7ae-839d02dfdf04 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.450932 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 954/1891] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:11.456619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b14a81-2a31-4b38-8a89-2be85943585f admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.467364 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b14a81-2a31-4b38-8a89-2be85943585f admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.474089 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 938/1892] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:11 2022] PUT /identity/v3/projects/c90e5260ee264f86ab7d314b2e364001/users/6f0f6777ac8b49af9156b43a22359ad8/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:11.479702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040214c-389d-476c-960d-85e945308bc0 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.480011 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040214c-389d-476c-960d-85e945308bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.480332 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040214c-389d-476c-960d-85e945308bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.515093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-d040214c-389d-476c-960d-85e945308bc0 None None] MFA Rules not processed for user `6f0f6777ac8b49af9156b43a22359ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:11.516619 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d040214c-389d-476c-960d-85e945308bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:11.529799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcf141-fe81-4132-9b50-a236eef31207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.530282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:11.530515 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcf141-fe81-4132-9b50-a236eef31207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.530831 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcf141-fe81-4132-9b50-a236eef31207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.531096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcf141-fe81-4132-9b50-a236eef31207 admin admin] PATH_INFO: `/v3/projects/829ef8fdde244636b02dd24925625643/users/e444b13dc34d4e7c9f4fad7d11ddb811/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.547409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcf141-fe81-4132-9b50-a236eef31207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829ef8fdde244636b02dd24925625643, user_id=e444b13dc34d4e7c9f4fad7d11ddb811, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.550133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcf141-fe81-4132-9b50-a236eef31207 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.564657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 955/1893] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:11 2022] PUT /identity/v3/projects/829ef8fdde244636b02dd24925625643/users/e444b13dc34d4e7c9f4fad7d11ddb811/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:11.566845 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcf141-fe81-4132-9b50-a236eef31207 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.590509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 939/1894] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:11.592028 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c18bdc-2f82-491a-8e83-8197f0d77d57 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.592587 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c18bdc-2f82-491a-8e83-8197f0d77d57 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.592787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c18bdc-2f82-491a-8e83-8197f0d77d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.620960 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-19c18bdc-2f82-491a-8e83-8197f0d77d57 None None] MFA Rules not processed for user `e444b13dc34d4e7c9f4fad7d11ddb811`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:11.622178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcf141-fe81-4132-9b50-a236eef31207 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.622324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-19c18bdc-2f82-491a-8e83-8197f0d77d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:11.626394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f8c7f-55d6-44e9-a877-174b05e3e64b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.627012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f8c7f-55d6-44e9-a877-174b05e3e64b service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.627290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f8c7f-55d6-44e9-a877-174b05e3e64b service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.628151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f8c7f-55d6-44e9-a877-174b05e3e64b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.629465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4c0f8c7f-55d6-44e9-a877-174b05e3e64b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:11.652673 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:11.688421 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 940/1895] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:11.689238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c18bdc-2f82-491a-8e83-8197f0d77d57 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.695640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f8c7f-55d6-44e9-a877-174b05e3e64b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.697206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f8c7f-55d6-44e9-a877-174b05e3e64b service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.706366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 956/1896] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:11.707151 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f8c7f-55d6-44e9-a877-174b05e3e64b service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.763513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c18bdc-2f82-491a-8e83-8197f0d77d57 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.768823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d4aa1-f093-46b2-9f80-043823d6f022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.769830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d4aa1-f093-46b2-9f80-043823d6f022 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.770154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d4aa1-f093-46b2-9f80-043823d6f022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.770436 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d4aa1-f093-46b2-9f80-043823d6f022 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.771160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d4aa1-f093-46b2-9f80-043823d6f022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.773390 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d4aa1-f093-46b2-9f80-043823d6f022 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.780553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f8c7f-55d6-44e9-a877-174b05e3e64b service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.790897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518b1f1-f5ad-4d13-80f3-d08d24d3ec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.791539 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518b1f1-f5ad-4d13-80f3-d08d24d3ec59 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.791860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518b1f1-f5ad-4d13-80f3-d08d24d3ec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.792081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518b1f1-f5ad-4d13-80f3-d08d24d3ec59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.792750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518b1f1-f5ad-4d13-80f3-d08d24d3ec59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.795757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518b1f1-f5ad-4d13-80f3-d08d24d3ec59 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:11.828979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 941/1897] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:11 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:11.841554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d4aa1-f093-46b2-9f80-043823d6f022 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.851860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 957/1898] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:11 2022] POST /identity/v3/projects => generated 399 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:11.856087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518b1f1-f5ad-4d13-80f3-d08d24d3ec59 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:11.933103 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:11.972538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518b1f1-f5ad-4d13-80f3-d08d24d3ec59 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:11.986860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395f879-0c63-4ca5-9203-d783ae563a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:11.987503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395f879-0c63-4ca5-9203-d783ae563a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:11.987779 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395f879-0c63-4ca5-9203-d783ae563a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:11.988128 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395f879-0c63-4ca5-9203-d783ae563a4e admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:11.988758 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395f879-0c63-4ca5-9203-d783ae563a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:11.993221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395f879-0c63-4ca5-9203-d783ae563a4e admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:12.011646 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d4aa1-f093-46b2-9f80-043823d6f022 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:12.025752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb889796-71b0-4c7b-aced-e230af15d170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:12.026692 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889796-71b0-4c7b-aced-e230af15d170 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.027424 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889796-71b0-4c7b-aced-e230af15d170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.029876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889796-71b0-4c7b-aced-e230af15d170 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.031044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb889796-71b0-4c7b-aced-e230af15d170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:12.035953 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb889796-71b0-4c7b-aced-e230af15d170 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:12.041687 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 958/1899] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:11 2022] POST /identity/v3/users => generated 306 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:12.044857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395f879-0c63-4ca5-9203-d783ae563a4e admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:12.070578 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395f879-0c63-4ca5-9203-d783ae563a4e admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:12.082209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26165b-651e-4f7e-b5a4-2d0120bee61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:12.082857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26165b-651e-4f7e-b5a4-2d0120bee61e admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.083143 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26165b-651e-4f7e-b5a4-2d0120bee61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.083436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26165b-651e-4f7e-b5a4-2d0120bee61e admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.084142 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26165b-651e-4f7e-b5a4-2d0120bee61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:12.085746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26165b-651e-4f7e-b5a4-2d0120bee61e admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:12.088996 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 942/1900] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:11 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:12.093708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb889796-71b0-4c7b-aced-e230af15d170 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:12.106665 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb889796-71b0-4c7b-aced-e230af15d170 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:12.116424 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1aad54-a8c9-4c50-b333-2991901d768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:12.118615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1aad54-a8c9-4c50-b333-2991901d768f admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.119694 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1aad54-a8c9-4c50-b333-2991901d768f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.120054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1aad54-a8c9-4c50-b333-2991901d768f admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.122879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1aad54-a8c9-4c50-b333-2991901d768f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:12.127726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 959/1901] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:12.131956 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26165b-651e-4f7e-b5a4-2d0120bee61e admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:12.134276 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1aad54-a8c9-4c50-b333-2991901d768f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:12.150248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26165b-651e-4f7e-b5a4-2d0120bee61e admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:12.162303 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 943/1902] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:12.162726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666a5f-73fd-4c6e-ba4b-fc99016f1baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:12.163488 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666a5f-73fd-4c6e-ba4b-fc99016f1baa admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.163775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666a5f-73fd-4c6e-ba4b-fc99016f1baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.164057 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666a5f-73fd-4c6e-ba4b-fc99016f1baa admin admin] PATH_INFO: `/v3/projects/4e7a5146c5dd45dc910c12b9a4792d32/users/db1475cbce5a4b2b92515ae9a657037b/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.167840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1aad54-a8c9-4c50-b333-2991901d768f admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:12.202620 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1aad54-a8c9-4c50-b333-2991901d768f admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:12.202985 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50666a5f-73fd-4c6e-ba4b-fc99016f1baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7a5146c5dd45dc910c12b9a4792d32, user_id=db1475cbce5a4b2b92515ae9a657037b, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:12.211788 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50666a5f-73fd-4c6e-ba4b-fc99016f1baa admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:12.219048 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de10527-ee99-4c58-988b-b3fecabfe17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:12.220576 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10527-ee99-4c58-988b-b3fecabfe17a admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.221241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10527-ee99-4c58-988b-b3fecabfe17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.222879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10527-ee99-4c58-988b-b3fecabfe17a admin admin] PATH_INFO: `/v3/projects/d71a9b2824784303a12907afcb3eaec0/users/d5759fe710ba4ba697d1dd2819fc5d33/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.233554 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:12.241464 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 960/1903] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:12 2022] PUT /identity/v3/projects/4e7a5146c5dd45dc910c12b9a4792d32/users/db1475cbce5a4b2b92515ae9a657037b/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:12.245691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666a5f-73fd-4c6e-ba4b-fc99016f1baa admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:12.256167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de10527-ee99-4c58-988b-b3fecabfe17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71a9b2824784303a12907afcb3eaec0, user_id=d5759fe710ba4ba697d1dd2819fc5d33, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:12.261984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de10527-ee99-4c58-988b-b3fecabfe17a admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:12.286091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 944/1904] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:12 2022] PUT /identity/v3/projects/d71a9b2824784303a12907afcb3eaec0/users/d5759fe710ba4ba697d1dd2819fc5d33/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:12.287578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de10527-ee99-4c58-988b-b3fecabfe17a admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:12.346390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666a5f-73fd-4c6e-ba4b-fc99016f1baa admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:12.390321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de10527-ee99-4c58-988b-b3fecabfe17a admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:12.398345 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1df8aa-c476-41d1-bfc9-9e8c0ac6917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:12.399449 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1df8aa-c476-41d1-bfc9-9e8c0ac6917b admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.399979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1df8aa-c476-41d1-bfc9-9e8c0ac6917b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.400515 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1df8aa-c476-41d1-bfc9-9e8c0ac6917b admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.401496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1df8aa-c476-41d1-bfc9-9e8c0ac6917b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:12.404689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1df8aa-c476-41d1-bfc9-9e8c0ac6917b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:12.420053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 945/1905] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:12.421408 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1df8aa-c476-41d1-bfc9-9e8c0ac6917b admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:12.442394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1df8aa-c476-41d1-bfc9-9e8c0ac6917b admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:12.449336 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2244b9e-381d-48e0-9cf9-63b067bfc605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:12.449520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507178b-1d82-44cb-924f-e7aa745b8613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:12.450568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507178b-1d82-44cb-924f-e7aa745b8613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.450568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507178b-1d82-44cb-924f-e7aa745b8613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.450759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507178b-1d82-44cb-924f-e7aa745b8613 admin admin] PATH_INFO: `/v3/users/ee3fd493bc954b8b9a462cab808a1b85` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.451367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2244b9e-381d-48e0-9cf9-63b067bfc605 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.451977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2244b9e-381d-48e0-9cf9-63b067bfc605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.452113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507178b-1d82-44cb-924f-e7aa745b8613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3fd493bc954b8b9a462cab808a1b85)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:12.452616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2244b9e-381d-48e0-9cf9-63b067bfc605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.453732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2244b9e-381d-48e0-9cf9-63b067bfc605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:12.454743 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507178b-1d82-44cb-924f-e7aa745b8613 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:12.456157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2244b9e-381d-48e0-9cf9-63b067bfc605 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:12.471024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 946/1906] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:12.472235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2244b9e-381d-48e0-9cf9-63b067bfc605 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:12.486674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2244b9e-381d-48e0-9cf9-63b067bfc605 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:12.493770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfef48-82a0-4601-9f2c-66ba58c0c095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:12.495155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfef48-82a0-4601-9f2c-66ba58c0c095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.496926 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfef48-82a0-4601-9f2c-66ba58c0c095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.496926 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfef48-82a0-4601-9f2c-66ba58c0c095 admin admin] PATH_INFO: `/v3/projects/4e7a5146c5dd45dc910c12b9a4792d32/users/db1475cbce5a4b2b92515ae9a657037b/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.499125 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfef48-82a0-4601-9f2c-66ba58c0c095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7a5146c5dd45dc910c12b9a4792d32, user_id=db1475cbce5a4b2b92515ae9a657037b, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:12.502502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfef48-82a0-4601-9f2c-66ba58c0c095 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:12.528204 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 947/1907] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:12 2022] PUT /identity/v3/projects/4e7a5146c5dd45dc910c12b9a4792d32/users/db1475cbce5a4b2b92515ae9a657037b/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:12.531088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfef48-82a0-4601-9f2c-66ba58c0c095 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:12.564822 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-5507178b-1d82-44cb-924f-e7aa745b8613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3fd493bc954b8b9a462cab808a1b85'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:12.580025 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-5507178b-1d82-44cb-924f-e7aa745b8613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3fd493bc954b8b9a462cab808a1b85'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:12.601884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-5507178b-1d82-44cb-924f-e7aa745b8613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3fd493bc954b8b9a462cab808a1b85'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:12.602679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-5507178b-1d82-44cb-924f-e7aa745b8613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3fd493bc954b8b9a462cab808a1b85'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:12.645264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-5507178b-1d82-44cb-924f-e7aa745b8613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3fd493bc954b8b9a462cab808a1b85'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:12.683766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 961/1908] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:12 2022] DELETE /identity/v3/users/ee3fd493bc954b8b9a462cab808a1b85 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:12.685945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253eff7-2d07-4657-98fb-9c05f8a9854e None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.686428 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253eff7-2d07-4657-98fb-9c05f8a9854e None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.686726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253eff7-2d07-4657-98fb-9c05f8a9854e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.697019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:12.706881 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfef48-82a0-4601-9f2c-66ba58c0c095 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:12.729951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-3253eff7-2d07-4657-98fb-9c05f8a9854e None None] MFA Rules not processed for user `db1475cbce5a4b2b92515ae9a657037b`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:12.736276 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3253eff7-2d07-4657-98fb-9c05f8a9854e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:12.783036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:12.835869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d8295-b21c-41ff-a1ce-54a6cbb69b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:12.837792 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d8295-b21c-41ff-a1ce-54a6cbb69b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.838260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d8295-b21c-41ff-a1ce-54a6cbb69b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.838825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d8295-b21c-41ff-a1ce-54a6cbb69b78 admin admin] PATH_INFO: `/v3/projects/d71a9b2824784303a12907afcb3eaec0/users/d5759fe710ba4ba697d1dd2819fc5d33/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.842086 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d8295-b21c-41ff-a1ce-54a6cbb69b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71a9b2824784303a12907afcb3eaec0, user_id=d5759fe710ba4ba697d1dd2819fc5d33, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:12.847466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d8295-b21c-41ff-a1ce-54a6cbb69b78 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:12.860551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 948/1909] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:12 2022] PUT /identity/v3/projects/d71a9b2824784303a12907afcb3eaec0/users/d5759fe710ba4ba697d1dd2819fc5d33/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:12.862202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff45a70-5bdf-4244-a6fa-d7260526c317 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.862624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff45a70-5bdf-4244-a6fa-d7260526c317 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.863031 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff45a70-5bdf-4244-a6fa-d7260526c317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.878919 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 962/1910] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:12.881710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cb22d-a17a-4452-a6d6-94442ab542cc None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:12.881710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cb22d-a17a-4452-a6d6-94442ab542cc None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:12.881963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cb22d-a17a-4452-a6d6-94442ab542cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:12.900134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-9ff45a70-5bdf-4244-a6fa-d7260526c317 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:12.902924 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9ff45a70-5bdf-4244-a6fa-d7260526c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:12.945436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-dc5cb22d-a17a-4452-a6d6-94442ab542cc None None] MFA Rules not processed for user `d5759fe710ba4ba697d1dd2819fc5d33`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:12.946859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-dc5cb22d-a17a-4452-a6d6-94442ab542cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:13.028011 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 949/1911] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:13.028981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff45a70-5bdf-4244-a6fa-d7260526c317 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:13.030659 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9ff45a70-5bdf-4244-a6fa-d7260526c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:13.051214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 963/1912] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:13.059997 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cb22d-a17a-4452-a6d6-94442ab542cc None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:13.063031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-dc5cb22d-a17a-4452-a6d6-94442ab542cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:13.184253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff45a70-5bdf-4244-a6fa-d7260526c317 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:13.192933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cb22d-a17a-4452-a6d6-94442ab542cc None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:13.193434 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97672b25-5204-449f-a221-a2cb0fc9036f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:13.194115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97672b25-5204-449f-a221-a2cb0fc9036f service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:13.194403 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97672b25-5204-449f-a221-a2cb0fc9036f service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:13.197478 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc86df0-e3f1-4a6b-8594-cc176f4b8e92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:13.198344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc86df0-e3f1-4a6b-8594-cc176f4b8e92 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:13.198685 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc86df0-e3f1-4a6b-8594-cc176f4b8e92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:13.198803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97672b25-5204-449f-a221-a2cb0fc9036f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:13.198959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc86df0-e3f1-4a6b-8594-cc176f4b8e92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:13.211470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc86df0-e3f1-4a6b-8594-cc176f4b8e92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:13.213625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc86df0-e3f1-4a6b-8594-cc176f4b8e92 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:13.229957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 964/1913] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:13.231435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc86df0-e3f1-4a6b-8594-cc176f4b8e92 service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:13.233069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3bc86df0-e3f1-4a6b-8594-cc176f4b8e92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:13.283700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:13.307531 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97672b25-5204-449f-a221-a2cb0fc9036f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:13.307769 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:13.311020 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97672b25-5204-449f-a221-a2cb0fc9036f service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:13.334791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc86df0-e3f1-4a6b-8594-cc176f4b8e92 service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:13.340734 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ef3fa-5023-4e1f-b116-c06294027c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:13.341578 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ef3fa-5023-4e1f-b116-c06294027c27 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:13.342149 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ef3fa-5023-4e1f-b116-c06294027c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:13.342663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ef3fa-5023-4e1f-b116-c06294027c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:13.364323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ef3fa-5023-4e1f-b116-c06294027c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:13.368300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ef3fa-5023-4e1f-b116-c06294027c27 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:13.368420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 950/1914] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:13.392041 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 965/1915] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:13.397062 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97672b25-5204-449f-a221-a2cb0fc9036f service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:13.398508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-97672b25-5204-449f-a221-a2cb0fc9036f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:13.414554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97672b25-5204-449f-a221-a2cb0fc9036f service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:13.421072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c81745-a20c-40ba-b787-a987760186bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:13.422032 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c81745-a20c-40ba-b787-a987760186bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:13.422456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c81745-a20c-40ba-b787-a987760186bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:13.422786 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c81745-a20c-40ba-b787-a987760186bb admin admin] PATH_INFO: `/v3/users/6f0f6777ac8b49af9156b43a22359ad8` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:13.424255 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c81745-a20c-40ba-b787-a987760186bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f0f6777ac8b49af9156b43a22359ad8)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:13.427056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c81745-a20c-40ba-b787-a987760186bb admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:13.514517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ef3fa-5023-4e1f-b116-c06294027c27 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:13.531624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ef3fa-5023-4e1f-b116-c06294027c27 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:13.541559 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3704e8a-3c43-4183-afaa-1af0bc999f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:13.542840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3704e8a-3c43-4183-afaa-1af0bc999f9a service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:13.543179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3704e8a-3c43-4183-afaa-1af0bc999f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:13.543584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3704e8a-3c43-4183-afaa-1af0bc999f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:13.546894 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c3704e8a-3c43-4183-afaa-1af0bc999f9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:13.555590 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-99c81745-a20c-40ba-b787-a987760186bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f0f6777ac8b49af9156b43a22359ad8'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:13.556524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-99c81745-a20c-40ba-b787-a987760186bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f0f6777ac8b49af9156b43a22359ad8'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:13.578575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-99c81745-a20c-40ba-b787-a987760186bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f0f6777ac8b49af9156b43a22359ad8'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:13.603054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-99c81745-a20c-40ba-b787-a987760186bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f0f6777ac8b49af9156b43a22359ad8'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:13.603895 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-99c81745-a20c-40ba-b787-a987760186bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f0f6777ac8b49af9156b43a22359ad8'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:13.627766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 951/1916] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:13 2022] DELETE /identity/v3/users/6f0f6777ac8b49af9156b43a22359ad8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:13.635539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23e132-5d55-4472-99ea-cc3db0c296dc None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:13.635899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23e132-5d55-4472-99ea-cc3db0c296dc None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:13.636204 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23e132-5d55-4472-99ea-cc3db0c296dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:13.667823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-7d23e132-5d55-4472-99ea-cc3db0c296dc None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:13.669080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7d23e132-5d55-4472-99ea-cc3db0c296dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:13.679557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3704e8a-3c43-4183-afaa-1af0bc999f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:13.681432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3704e8a-3c43-4183-afaa-1af0bc999f9a service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:13.697939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 966/1917] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:13 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:13.780513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 952/1918] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:13.819356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3704e8a-3c43-4183-afaa-1af0bc999f9a service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:13.836944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3704e8a-3c43-4183-afaa-1af0bc999f9a service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:13.945713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f8ad3-c441-490b-80bf-4389f73f8893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:13.946458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8ad3-c441-490b-80bf-4389f73f8893 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:13.946678 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8ad3-c441-490b-80bf-4389f73f8893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:13.946950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f8ad3-c441-490b-80bf-4389f73f8893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:13.959596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f8ad3-c441-490b-80bf-4389f73f8893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:13.962616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f8ad3-c441-490b-80bf-4389f73f8893 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:13.976739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 967/1919] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:14.343631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23e132-5d55-4472-99ea-cc3db0c296dc None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:14.345705 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7d23e132-5d55-4472-99ea-cc3db0c296dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:14.380619 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23e132-5d55-4472-99ea-cc3db0c296dc None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:14.388631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:14.389314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:14.389861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:14.389861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] PATH_INFO: `/v3/projects/4157d2ed36b34ae7ae6cc735cfedd1cf` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:14.396449 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4157d2ed36b34ae7ae6cc735cfedd1cf)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:14.398433 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:14.469489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4157d2ed36b34ae7ae6cc735cfedd1cf', 'request_id': 'req-88777f27-bc46-47ad-80a5-bd7f521c9f7b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:14.477008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4157d2ed36b34ae7ae6cc735cfedd1cf', 'request_id': 'req-88777f27-bc46-47ad-80a5-bd7f521c9f7b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:14.479268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:14.484986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4157d2ed36b34ae7ae6cc735cfedd1cf', 'request_id': 'req-88777f27-bc46-47ad-80a5-bd7f521c9f7b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:14.503909 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] The token cache is being invalidate because project 4157d2ed36b34ae7ae6cc735cfedd1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:14.504546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:14.505816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:14.509830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 953/1920] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:14 2022] DELETE /identity/v3/projects/4157d2ed36b34ae7ae6cc735cfedd1cf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:14.514777 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f8ad3-c441-490b-80bf-4389f73f8893 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:14.532807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f8ad3-c441-490b-80bf-4389f73f8893 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:14.624948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:14.625761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:14.626236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:14.626630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] PATH_INFO: `/v3/users/7f756609bda94fa2aae9dd73141e0252` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:14.627999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f756609bda94fa2aae9dd73141e0252)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:14.630180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:14.667910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:14.698096 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f756609bda94fa2aae9dd73141e0252'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:14.719671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f756609bda94fa2aae9dd73141e0252'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:14.737444 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f756609bda94fa2aae9dd73141e0252'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:14.738327 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f756609bda94fa2aae9dd73141e0252'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:14.766187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f756609bda94fa2aae9dd73141e0252'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:14.779578 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 968/1921] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:14 2022] DELETE /identity/v3/users/7f756609bda94fa2aae9dd73141e0252 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:14.838447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:14.840457 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:14.857260 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88777f27-bc46-47ad-80a5-bd7f521c9f7b admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:14.924188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:14.925601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:14.928127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:14.928127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] PATH_INFO: `/v3/projects/c90e5260ee264f86ab7d314b2e364001` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:14.929857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c90e5260ee264f86ab7d314b2e364001)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:14.931865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:14.989200 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c90e5260ee264f86ab7d314b2e364001', 'request_id': 'req-f0adb139-8343-4b84-b14a-79465d6e09d6'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:14.998876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c90e5260ee264f86ab7d314b2e364001', 'request_id': 'req-f0adb139-8343-4b84-b14a-79465d6e09d6'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.004379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c90e5260ee264f86ab7d314b2e364001', 'request_id': 'req-f0adb139-8343-4b84-b14a-79465d6e09d6'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.017926 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] The token cache is being invalidate because project c90e5260ee264f86ab7d314b2e364001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:15.018245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.018896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.020439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 954/1922] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:14 2022] DELETE /identity/v3/projects/c90e5260ee264f86ab7d314b2e364001 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:15.024383 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:15.025776 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:15.039313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f345c8-d111-40fc-9014-4000bf4fe05c admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:15.102771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca753174-cd08-4d0c-9e1b-da6093cf797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:15.103417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca753174-cd08-4d0c-9e1b-da6093cf797d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.103698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca753174-cd08-4d0c-9e1b-da6093cf797d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.103971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca753174-cd08-4d0c-9e1b-da6093cf797d admin admin] PATH_INFO: `/v3/users/d5759fe710ba4ba697d1dd2819fc5d33` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.105220 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca753174-cd08-4d0c-9e1b-da6093cf797d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5759fe710ba4ba697d1dd2819fc5d33)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:15.108887 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca753174-cd08-4d0c-9e1b-da6093cf797d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:15.109973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:15.111636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:15.136386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adb139-8343-4b84-b14a-79465d6e09d6 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:15.142207 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:15.142948 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.143233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.143512 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] PATH_INFO: `/v3/projects/ac5668786df647929be2ec2c1ceebb52` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.144759 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5668786df647929be2ec2c1ceebb52)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:15.147471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:15.161883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ca753174-cd08-4d0c-9e1b-da6093cf797d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5759fe710ba4ba697d1dd2819fc5d33'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.169390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ca753174-cd08-4d0c-9e1b-da6093cf797d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5759fe710ba4ba697d1dd2819fc5d33'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.184505 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ca753174-cd08-4d0c-9e1b-da6093cf797d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5759fe710ba4ba697d1dd2819fc5d33'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.184928 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ca753174-cd08-4d0c-9e1b-da6093cf797d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5759fe710ba4ba697d1dd2819fc5d33'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.200333 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ca753174-cd08-4d0c-9e1b-da6093cf797d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5759fe710ba4ba697d1dd2819fc5d33'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.207005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 969/1923] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:15 2022] DELETE /identity/v3/users/d5759fe710ba4ba697d1dd2819fc5d33 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:15.218860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5668786df647929be2ec2c1ceebb52', 'request_id': 'req-3e017ede-82c3-4c41-86b5-bc24c0627932'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.244183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5668786df647929be2ec2c1ceebb52', 'request_id': 'req-3e017ede-82c3-4c41-86b5-bc24c0627932'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.252440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5668786df647929be2ec2c1ceebb52', 'request_id': 'req-3e017ede-82c3-4c41-86b5-bc24c0627932'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.270402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:15.282662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] The token cache is being invalidate because project ac5668786df647929be2ec2c1ceebb52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:15.285581 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.286192 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-3e017ede-82c3-4c41-86b5-bc24c0627932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.290426 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 955/1924] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:15 2022] DELETE /identity/v3/projects/ac5668786df647929be2ec2c1ceebb52 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:15.297545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2df60-9b44-4b60-97cf-a0251f747bd9 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.298044 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2df60-9b44-4b60-97cf-a0251f747bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.298460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2df60-9b44-4b60-97cf-a0251f747bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.329830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-cde2df60-9b44-4b60-97cf-a0251f747bd9 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:15.331744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-cde2df60-9b44-4b60-97cf-a0251f747bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:15.363196 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:15.419460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 970/1925] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:15.428072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c63d2-57d4-44de-990d-78414a1082a9 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.429409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c63d2-57d4-44de-990d-78414a1082a9 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.429830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c63d2-57d4-44de-990d-78414a1082a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.463588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-7b4c63d2-57d4-44de-990d-78414a1082a9 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:15.464840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7b4c63d2-57d4-44de-990d-78414a1082a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:15.480317 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 956/1926] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:15.481675 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2df60-9b44-4b60-97cf-a0251f747bd9 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:15.499335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2df60-9b44-4b60-97cf-a0251f747bd9 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:15.507736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da5a8e-c15b-4ce4-b506-b9d5371d2bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:15.508523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5a8e-c15b-4ce4-b506-b9d5371d2bee admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.508915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5a8e-c15b-4ce4-b506-b9d5371d2bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.509173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da5a8e-c15b-4ce4-b506-b9d5371d2bee admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.510092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da5a8e-c15b-4ce4-b506-b9d5371d2bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:15.510777 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da5a8e-c15b-4ce4-b506-b9d5371d2bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:15.512170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da5a8e-c15b-4ce4-b506-b9d5371d2bee admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:15.534258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 971/1927] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:15.535682 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c63d2-57d4-44de-990d-78414a1082a9 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:15.549154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c63d2-57d4-44de-990d-78414a1082a9 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:15.554921 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2155c-35d4-4f6c-8bdf-ac6fb56df00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:15.555570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2155c-35d4-4f6c-8bdf-ac6fb56df00f admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.555909 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2155c-35d4-4f6c-8bdf-ac6fb56df00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.556191 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2155c-35d4-4f6c-8bdf-ac6fb56df00f admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.556878 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2155c-35d4-4f6c-8bdf-ac6fb56df00f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:15.559121 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2155c-35d4-4f6c-8bdf-ac6fb56df00f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:15.618902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 957/1928] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:15 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:15.620090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da5a8e-c15b-4ce4-b506-b9d5371d2bee admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:15.636000 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da5a8e-c15b-4ce4-b506-b9d5371d2bee admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:15.721047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d4c80-1700-4ac0-ab8f-72ed0b4f291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:15.721681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d4c80-1700-4ac0-ab8f-72ed0b4f291e admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.721965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d4c80-1700-4ac0-ab8f-72ed0b4f291e admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.722302 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d4c80-1700-4ac0-ab8f-72ed0b4f291e admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.722986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d4c80-1700-4ac0-ab8f-72ed0b4f291e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:15.724949 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d4c80-1700-4ac0-ab8f-72ed0b4f291e admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:15.766186 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2155c-35d4-4f6c-8bdf-ac6fb56df00f admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:15.766573 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 972/1929] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:15 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:15.782341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2155c-35d4-4f6c-8bdf-ac6fb56df00f admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:15.788468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61d63-534c-4de5-b5d1-02bc4ac13d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:15.789048 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61d63-534c-4de5-b5d1-02bc4ac13d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.789332 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61d63-534c-4de5-b5d1-02bc4ac13d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.789603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61d63-534c-4de5-b5d1-02bc4ac13d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.790379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce61d63-534c-4de5-b5d1-02bc4ac13d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:15.791921 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce61d63-534c-4de5-b5d1-02bc4ac13d21 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:15.809214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 958/1930] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:15.809870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d4c80-1700-4ac0-ab8f-72ed0b4f291e admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:15.823402 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d4c80-1700-4ac0-ab8f-72ed0b4f291e admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:15.824452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61d63-534c-4de5-b5d1-02bc4ac13d21 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:15.826267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-1ce61d63-534c-4de5-b5d1-02bc4ac13d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:15.831384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844f5d3-1dcb-4c71-8d1b-2921a7d78d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:15.832434 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844f5d3-1dcb-4c71-8d1b-2921a7d78d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.833042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844f5d3-1dcb-4c71-8d1b-2921a7d78d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.834897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844f5d3-1dcb-4c71-8d1b-2921a7d78d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.836120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844f5d3-1dcb-4c71-8d1b-2921a7d78d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:15.838423 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844f5d3-1dcb-4c71-8d1b-2921a7d78d45 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:15.843342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61d63-534c-4de5-b5d1-02bc4ac13d21 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:15.848261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:15.849400 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.849841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.850415 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] PATH_INFO: `/v3/projects/d71a9b2824784303a12907afcb3eaec0` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.853082 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71a9b2824784303a12907afcb3eaec0)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:15.855693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:15.861733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 973/1931] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:15.862976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844f5d3-1dcb-4c71-8d1b-2921a7d78d45 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:15.875632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844f5d3-1dcb-4c71-8d1b-2921a7d78d45 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:15.882473 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3e122-b793-47fa-926b-2893dc905390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:15.883163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e122-b793-47fa-926b-2893dc905390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.883446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e122-b793-47fa-926b-2893dc905390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.883724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3e122-b793-47fa-926b-2893dc905390 admin admin] PATH_INFO: `/v3/projects/ba75498ead7548208571bc390ef8e144/users/0e593ed091b04272a71f07b0ad3a308b/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.907393 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3e122-b793-47fa-926b-2893dc905390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba75498ead7548208571bc390ef8e144, user_id=0e593ed091b04272a71f07b0ad3a308b, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:15.910334 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3e122-b793-47fa-926b-2893dc905390 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:15.946486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 974/1932] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:15 2022] PUT /identity/v3/projects/ba75498ead7548208571bc390ef8e144/users/0e593ed091b04272a71f07b0ad3a308b/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:15.956969 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71a9b2824784303a12907afcb3eaec0', 'request_id': 'req-b6f8f9af-6408-4c4e-815d-d502b3990650'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.958432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9901-6661-4124-9362-85abdaee4bcb None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:15.958727 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9901-6661-4124-9362-85abdaee4bcb None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:15.959004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9901-6661-4124-9362-85abdaee4bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:15.971616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71a9b2824784303a12907afcb3eaec0', 'request_id': 'req-b6f8f9af-6408-4c4e-815d-d502b3990650'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:15.982745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71a9b2824784303a12907afcb3eaec0', 'request_id': 'req-b6f8f9af-6408-4c4e-815d-d502b3990650'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:16.003910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-9d5d9901-6661-4124-9362-85abdaee4bcb None None] MFA Rules not processed for user `0e593ed091b04272a71f07b0ad3a308b`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:16.005583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9d5d9901-6661-4124-9362-85abdaee4bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:16.014292 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] The token cache is being invalidate because project d71a9b2824784303a12907afcb3eaec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:16.014630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:16.017220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6f8f9af-6408-4c4e-815d-d502b3990650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:16.028644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 959/1933] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:15 2022] DELETE /identity/v3/projects/d71a9b2824784303a12907afcb3eaec0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:16.030361 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876eb24-8ab5-4c3a-89c4-3912d55a6146 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.030647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876eb24-8ab5-4c3a-89c4-3912d55a6146 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.030924 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876eb24-8ab5-4c3a-89c4-3912d55a6146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.062050 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3876eb24-8ab5-4c3a-89c4-3912d55a6146 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:16.064881 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3876eb24-8ab5-4c3a-89c4-3912d55a6146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:16.100989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:16.121404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 975/1934] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:16.140181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d9901-6661-4124-9362-85abdaee4bcb None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:16.141844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9d5d9901-6661-4124-9362-85abdaee4bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:16.157046 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 960/1935] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:16.168227 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e2995-fd85-4574-aeba-003e6443091c None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.168514 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e2995-fd85-4574-aeba-003e6443091c None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.168790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e2995-fd85-4574-aeba-003e6443091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.196237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-dd0e2995-fd85-4574-aeba-003e6443091c None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:16.197479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-dd0e2995-fd85-4574-aeba-003e6443091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:16.210667 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 961/1936] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:16.213040 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e2995-fd85-4574-aeba-003e6443091c None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:16.223467 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e2995-fd85-4574-aeba-003e6443091c None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:16.225130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d9901-6661-4124-9362-85abdaee4bcb None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:16.228935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f606-3267-43b8-9f9b-8ae08a31b5f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:16.229206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032dd59-c991-4d14-a29e-ae737b496b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:16.229564 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f606-3267-43b8-9f9b-8ae08a31b5f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.229829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032dd59-c991-4d14-a29e-ae737b496b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.229941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f606-3267-43b8-9f9b-8ae08a31b5f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.230139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032dd59-c991-4d14-a29e-ae737b496b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.230252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f606-3267-43b8-9f9b-8ae08a31b5f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.230420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032dd59-c991-4d14-a29e-ae737b496b06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.231115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032dd59-c991-4d14-a29e-ae737b496b06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:16.231422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032dd59-c991-4d14-a29e-ae737b496b06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:16.233102 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032dd59-c991-4d14-a29e-ae737b496b06 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:16.240010 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987f606-3267-43b8-9f9b-8ae08a31b5f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:16.242361 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987f606-3267-43b8-9f9b-8ae08a31b5f0 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:16.246606 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 962/1937] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:16.251357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032dd59-c991-4d14-a29e-ae737b496b06 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:16.256591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 976/1938] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:16.263403 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032dd59-c991-4d14-a29e-ae737b496b06 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:16.282766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c216c13-ac6f-46a0-905f-b5b4a57e9cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:16.283472 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c216c13-ac6f-46a0-905f-b5b4a57e9cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.283779 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c216c13-ac6f-46a0-905f-b5b4a57e9cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.283925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f606-3267-43b8-9f9b-8ae08a31b5f0 service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:16.284301 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c216c13-ac6f-46a0-905f-b5b4a57e9cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.285089 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c216c13-ac6f-46a0-905f-b5b4a57e9cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:16.285773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f987f606-3267-43b8-9f9b-8ae08a31b5f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:16.287791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c216c13-ac6f-46a0-905f-b5b4a57e9cb7 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:16.303022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f606-3267-43b8-9f9b-8ae08a31b5f0 service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:16.309508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af92ed-ba8b-4999-8f9f-9511c0a946cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:16.310187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af92ed-ba8b-4999-8f9f-9511c0a946cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.310470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af92ed-ba8b-4999-8f9f-9511c0a946cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.310742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af92ed-ba8b-4999-8f9f-9511c0a946cf admin admin] PATH_INFO: `/v3/users/0e593ed091b04272a71f07b0ad3a308b` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.311935 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af92ed-ba8b-4999-8f9f-9511c0a946cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e593ed091b04272a71f07b0ad3a308b)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:16.312539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:16.313834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af92ed-ba8b-4999-8f9f-9511c0a946cf admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:16.324793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 963/1939] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:16 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:16.326839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c216c13-ac6f-46a0-905f-b5b4a57e9cb7 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:16.378410 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-23af92ed-ba8b-4999-8f9f-9511c0a946cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e593ed091b04272a71f07b0ad3a308b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:16.387316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-23af92ed-ba8b-4999-8f9f-9511c0a946cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e593ed091b04272a71f07b0ad3a308b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:16.397421 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-23af92ed-ba8b-4999-8f9f-9511c0a946cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e593ed091b04272a71f07b0ad3a308b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:16.398591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-23af92ed-ba8b-4999-8f9f-9511c0a946cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e593ed091b04272a71f07b0ad3a308b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:16.412318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-23af92ed-ba8b-4999-8f9f-9511c0a946cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e593ed091b04272a71f07b0ad3a308b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:16.412831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c216c13-ac6f-46a0-905f-b5b4a57e9cb7 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:16.417513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffb2a0-258c-49fd-a558-07ae6cbb632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:16.418482 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffb2a0-258c-49fd-a558-07ae6cbb632f admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.418705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 977/1940] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:16 2022] DELETE /identity/v3/users/0e593ed091b04272a71f07b0ad3a308b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:16.418804 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffb2a0-258c-49fd-a558-07ae6cbb632f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.418804 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffb2a0-258c-49fd-a558-07ae6cbb632f admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.419357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffb2a0-258c-49fd-a558-07ae6cbb632f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:16.421263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffb2a0-258c-49fd-a558-07ae6cbb632f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:16.422807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306e9c-98bd-43a1-92b0-82cc8bfde379 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.423098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306e9c-98bd-43a1-92b0-82cc8bfde379 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.423379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306e9c-98bd-43a1-92b0-82cc8bfde379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.447250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-4d306e9c-98bd-43a1-92b0-82cc8bfde379 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:16.448545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4d306e9c-98bd-43a1-92b0-82cc8bfde379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:16.459288 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 964/1941] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:16 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:16.463421 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffb2a0-258c-49fd-a558-07ae6cbb632f admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:16.465190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-91ffb2a0-258c-49fd-a558-07ae6cbb632f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:16.477853 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffb2a0-258c-49fd-a558-07ae6cbb632f admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:16.509654 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 978/1942] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:16.519929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306e9c-98bd-43a1-92b0-82cc8bfde379 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:16.521949 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4d306e9c-98bd-43a1-92b0-82cc8bfde379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:16.533078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:16.535883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499443c-0643-4bfc-a0ca-37302e92b813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:16.536539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499443c-0643-4bfc-a0ca-37302e92b813 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.536826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499443c-0643-4bfc-a0ca-37302e92b813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.537102 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499443c-0643-4bfc-a0ca-37302e92b813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.537817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499443c-0643-4bfc-a0ca-37302e92b813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:16.539996 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499443c-0643-4bfc-a0ca-37302e92b813 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:16.553242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 965/1943] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:16.554287 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499443c-0643-4bfc-a0ca-37302e92b813 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:16.564194 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499443c-0643-4bfc-a0ca-37302e92b813 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:16.569459 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4fa5d-b7f8-4a46-97cd-7b6448036c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:16.570089 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4fa5d-b7f8-4a46-97cd-7b6448036c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.570372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4fa5d-b7f8-4a46-97cd-7b6448036c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.570755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4fa5d-b7f8-4a46-97cd-7b6448036c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.571442 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4fa5d-b7f8-4a46-97cd-7b6448036c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:16.573002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4fa5d-b7f8-4a46-97cd-7b6448036c5d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:16.584040 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 966/1944] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:16.587397 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306e9c-98bd-43a1-92b0-82cc8bfde379 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:16.588012 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4fa5d-b7f8-4a46-97cd-7b6448036c5d admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:16.589881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356ae78-96cc-49ac-9477-3b35128b084e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:16.590549 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ae78-96cc-49ac-9477-3b35128b084e service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.590831 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ae78-96cc-49ac-9477-3b35128b084e service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.591108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356ae78-96cc-49ac-9477-3b35128b084e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.598388 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4fa5d-b7f8-4a46-97cd-7b6448036c5d admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:16.604472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356ae78-96cc-49ac-9477-3b35128b084e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:16.605917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356ae78-96cc-49ac-9477-3b35128b084e service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:16.606963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e1f86-19d4-41a6-a228-4b1864f7b5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:16.607638 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1f86-19d4-41a6-a228-4b1864f7b5e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.607902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1f86-19d4-41a6-a228-4b1864f7b5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.608191 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1f86-19d4-41a6-a228-4b1864f7b5e7 admin admin] PATH_INFO: `/v3/projects/3743d4bf565c46a0bf93b18e154576af/users/852674a0902b4c328fbebbb945a98639/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.615948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 979/1945] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:16.623029 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e1f86-19d4-41a6-a228-4b1864f7b5e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3743d4bf565c46a0bf93b18e154576af, user_id=852674a0902b4c328fbebbb945a98639, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:16.625669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e1f86-19d4-41a6-a228-4b1864f7b5e7 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:16.639751 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 967/1946] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:16 2022] PUT /identity/v3/projects/3743d4bf565c46a0bf93b18e154576af/users/852674a0902b4c328fbebbb945a98639/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:16.650998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6be6d6-2698-4f14-9587-d57f0c77bb3b None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.651332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6be6d6-2698-4f14-9587-d57f0c77bb3b None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.651653 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6be6d6-2698-4f14-9587-d57f0c77bb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.684484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-fc6be6d6-2698-4f14-9587-d57f0c77bb3b None None] MFA Rules not processed for user `852674a0902b4c328fbebbb945a98639`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:16.685694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fc6be6d6-2698-4f14-9587-d57f0c77bb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:16.802967 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 980/1947] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:16.807771 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e1f86-19d4-41a6-a228-4b1864f7b5e7 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:16.882465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:16.896671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e1f86-19d4-41a6-a228-4b1864f7b5e7 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:16.904790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e085dfb-0a96-4e97-a07b-72b82959b82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:16.905747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e085dfb-0a96-4e97-a07b-72b82959b82b admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:16.905747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e085dfb-0a96-4e97-a07b-72b82959b82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:16.908641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e085dfb-0a96-4e97-a07b-72b82959b82b admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:16.908641 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e085dfb-0a96-4e97-a07b-72b82959b82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:16.910185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e085dfb-0a96-4e97-a07b-72b82959b82b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:16.951480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6be6d6-2698-4f14-9587-d57f0c77bb3b None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:16.953622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 968/1948] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:16 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:16.966906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6be6d6-2698-4f14-9587-d57f0c77bb3b None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.048421 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa0b34-d001-4f56-8013-b25c5de37d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.049334 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa0b34-d001-4f56-8013-b25c5de37d6e admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.049646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa0b34-d001-4f56-8013-b25c5de37d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.050312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa0b34-d001-4f56-8013-b25c5de37d6e admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.050925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa0b34-d001-4f56-8013-b25c5de37d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.053673 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa0b34-d001-4f56-8013-b25c5de37d6e admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.065904 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e085dfb-0a96-4e97-a07b-72b82959b82b admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.069000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-0e085dfb-0a96-4e97-a07b-72b82959b82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:17.079216 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 981/1949] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:16 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:17.088405 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e085dfb-0a96-4e97-a07b-72b82959b82b admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.095391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa0b34-d001-4f56-8013-b25c5de37d6e admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.108350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa0b34-d001-4f56-8013-b25c5de37d6e admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.122585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f046-ea46-4dd9-b38f-3f8116b75ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.122585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f046-ea46-4dd9-b38f-3f8116b75ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.122585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f046-ea46-4dd9-b38f-3f8116b75ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.122585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f046-ea46-4dd9-b38f-3f8116b75ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.123113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65f046-ea46-4dd9-b38f-3f8116b75ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.123113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65f046-ea46-4dd9-b38f-3f8116b75ce8 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.126452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.127300 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.127751 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.128173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] PATH_INFO: `/v3/projects/ba75498ead7548208571bc390ef8e144` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.132447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba75498ead7548208571bc390ef8e144)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.136129 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.153418 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 982/1950] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:17.158071 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f046-ea46-4dd9-b38f-3f8116b75ce8 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.169661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65f046-ea46-4dd9-b38f-3f8116b75ce8 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.175394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a037a-0e00-431d-8ecf-136241703135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.176082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a037a-0e00-431d-8ecf-136241703135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.176353 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a037a-0e00-431d-8ecf-136241703135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.176631 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a037a-0e00-431d-8ecf-136241703135 admin admin] PATH_INFO: `/v3/projects/492ca5110ff2478fa6e94ee38df26463/users/84523beb0c75429a99514d754443da99/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.195218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a037a-0e00-431d-8ecf-136241703135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492ca5110ff2478fa6e94ee38df26463, user_id=84523beb0c75429a99514d754443da99, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.198673 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a037a-0e00-431d-8ecf-136241703135 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.202407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:17.206992 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba75498ead7548208571bc390ef8e144', 'request_id': 'req-e708f7e2-29e3-4dce-946c-c95a9648c646'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:17.215275 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba75498ead7548208571bc390ef8e144', 'request_id': 'req-e708f7e2-29e3-4dce-946c-c95a9648c646'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:17.221419 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba75498ead7548208571bc390ef8e144', 'request_id': 'req-e708f7e2-29e3-4dce-946c-c95a9648c646'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:17.227601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 983/1951] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:17 2022] PUT /identity/v3/projects/492ca5110ff2478fa6e94ee38df26463/users/84523beb0c75429a99514d754443da99/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:17.228752 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a037a-0e00-431d-8ecf-136241703135 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.234921 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] The token cache is being invalidate because project ba75498ead7548208571bc390ef8e144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:17.235394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:17.236132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-e708f7e2-29e3-4dce-946c-c95a9648c646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:17.237825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 969/1952] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:17 2022] DELETE /identity/v3/projects/ba75498ead7548208571bc390ef8e144 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:17.243189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9731f-4bc0-4b3b-b5e7-f22ff1ea567d None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.243495 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9731f-4bc0-4b3b-b5e7-f22ff1ea567d None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.243777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9731f-4bc0-4b3b-b5e7-f22ff1ea567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.264493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-60d9731f-4bc0-4b3b-b5e7-f22ff1ea567d None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:17.266132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-60d9731f-4bc0-4b3b-b5e7-f22ff1ea567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:17.319508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a037a-0e00-431d-8ecf-136241703135 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.325961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763db58-b510-4bdc-93af-45a41dbba9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.326677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763db58-b510-4bdc-93af-45a41dbba9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.326886 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763db58-b510-4bdc-93af-45a41dbba9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.327572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763db58-b510-4bdc-93af-45a41dbba9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.327843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763db58-b510-4bdc-93af-45a41dbba9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.329562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763db58-b510-4bdc-93af-45a41dbba9c8 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.335139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 970/1953] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:17.341378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 984/1954] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:17.342821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f261176-944c-483c-b032-f077e0779693 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.343112 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f261176-944c-483c-b032-f077e0779693 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.343386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f261176-944c-483c-b032-f077e0779693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.347118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763db58-b510-4bdc-93af-45a41dbba9c8 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.348819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-8763db58-b510-4bdc-93af-45a41dbba9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:17.367747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763db58-b510-4bdc-93af-45a41dbba9c8 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.372805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfc88b-58e4-4127-819a-8263751f5324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.373573 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc88b-58e4-4127-819a-8263751f5324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.373861 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc88b-58e4-4127-819a-8263751f5324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.374167 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfc88b-58e4-4127-819a-8263751f5324 admin admin] PATH_INFO: `/v3/projects/492ca5110ff2478fa6e94ee38df26463/users/84523beb0c75429a99514d754443da99/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.376522 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfc88b-58e4-4127-819a-8263751f5324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492ca5110ff2478fa6e94ee38df26463, user_id=84523beb0c75429a99514d754443da99, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.378266 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6f261176-944c-483c-b032-f077e0779693 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:17.379018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfc88b-58e4-4127-819a-8263751f5324 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.379466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6f261176-944c-483c-b032-f077e0779693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:17.392288 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 971/1955] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:17.392495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 985/1956] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:17 2022] PUT /identity/v3/projects/492ca5110ff2478fa6e94ee38df26463/users/84523beb0c75429a99514d754443da99/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:17.397114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f261176-944c-483c-b032-f077e0779693 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.406905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f261176-944c-483c-b032-f077e0779693 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.407437 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e358-b860-43dc-aea6-e141cce7edd6 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.407867 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e358-b860-43dc-aea6-e141cce7edd6 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.409031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07e358-b860-43dc-aea6-e141cce7edd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.440012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-ab07e358-b860-43dc-aea6-e141cce7edd6 None None] MFA Rules not processed for user `84523beb0c75429a99514d754443da99`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:17.441236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ab07e358-b860-43dc-aea6-e141cce7edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:17.455998 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:17.467500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b85e8-a8c7-4824-867f-c96ba7f5d7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.468129 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b85e8-a8c7-4824-867f-c96ba7f5d7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.468637 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b85e8-a8c7-4824-867f-c96ba7f5d7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.469177 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b85e8-a8c7-4824-867f-c96ba7f5d7b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.469940 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b85e8-a8c7-4824-867f-c96ba7f5d7b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:17.470287 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b85e8-a8c7-4824-867f-c96ba7f5d7b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.471925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b85e8-a8c7-4824-867f-c96ba7f5d7b7 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.483651 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 972/1957] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:17.488111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b85e8-a8c7-4824-867f-c96ba7f5d7b7 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.497965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b85e8-a8c7-4824-867f-c96ba7f5d7b7 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.502886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a3594-9c59-44d6-a096-5d8327a45839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.503485 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3594-9c59-44d6-a096-5d8327a45839 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.503769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3594-9c59-44d6-a096-5d8327a45839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.504044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a3594-9c59-44d6-a096-5d8327a45839 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.504704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a3594-9c59-44d6-a096-5d8327a45839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.507147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a3594-9c59-44d6-a096-5d8327a45839 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.511956 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 986/1958] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:17.523565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e358-b860-43dc-aea6-e141cce7edd6 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.524936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ab07e358-b860-43dc-aea6-e141cce7edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:17.540716 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 973/1959] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:17 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:17.542221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a3594-9c59-44d6-a096-5d8327a45839 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.583343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07e358-b860-43dc-aea6-e141cce7edd6 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.599965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:17.607769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a3594-9c59-44d6-a096-5d8327a45839 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.612829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6281fe-7a55-4246-872c-a2454a9d31bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.613514 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6281fe-7a55-4246-872c-a2454a9d31bf admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.613820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6281fe-7a55-4246-872c-a2454a9d31bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.614657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6281fe-7a55-4246-872c-a2454a9d31bf admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.615341 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6281fe-7a55-4246-872c-a2454a9d31bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.617290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6281fe-7a55-4246-872c-a2454a9d31bf admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.635392 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c76855-cb51-46dd-baf2-8f834dbbce80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.636586 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c76855-cb51-46dd-baf2-8f834dbbce80 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.636865 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c76855-cb51-46dd-baf2-8f834dbbce80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.637139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c76855-cb51-46dd-baf2-8f834dbbce80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.639116 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 974/1960] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:17 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:17.643293 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6281fe-7a55-4246-872c-a2454a9d31bf admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.653159 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6281fe-7a55-4246-872c-a2454a9d31bf admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.657881 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514701d-62f7-4d81-a84b-e681e0122a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.658523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514701d-62f7-4d81-a84b-e681e0122a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.658800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514701d-62f7-4d81-a84b-e681e0122a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.659073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514701d-62f7-4d81-a84b-e681e0122a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.659870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514701d-62f7-4d81-a84b-e681e0122a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.661487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514701d-62f7-4d81-a84b-e681e0122a8d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.674798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 975/1961] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:17.679374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514701d-62f7-4d81-a84b-e681e0122a8d admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.689022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514701d-62f7-4d81-a84b-e681e0122a8d admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.694359 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b688b0-1fe0-4bd6-b8b5-fe80198d8692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.694955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b688b0-1fe0-4bd6-b8b5-fe80198d8692 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.695236 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b688b0-1fe0-4bd6-b8b5-fe80198d8692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.695508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b688b0-1fe0-4bd6-b8b5-fe80198d8692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.696191 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b688b0-1fe0-4bd6-b8b5-fe80198d8692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.697754 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b688b0-1fe0-4bd6-b8b5-fe80198d8692 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.708324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 976/1962] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:17.709368 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c76855-cb51-46dd-baf2-8f834dbbce80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.710840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c76855-cb51-46dd-baf2-8f834dbbce80 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.712342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b688b0-1fe0-4bd6-b8b5-fe80198d8692 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.720599 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 987/1963] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:17.722695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b688b0-1fe0-4bd6-b8b5-fe80198d8692 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.727344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226fedd-d4bf-4354-9b3c-05d37e7f43b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.727941 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226fedd-d4bf-4354-9b3c-05d37e7f43b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.728218 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226fedd-d4bf-4354-9b3c-05d37e7f43b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.728489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226fedd-d4bf-4354-9b3c-05d37e7f43b5 admin admin] PATH_INFO: `/v3/projects/29a895181fb145e79ad055b32dd740dd/users/82e8d294c4c64f8584bbc6b442d5b26c/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.744262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226fedd-d4bf-4354-9b3c-05d37e7f43b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a895181fb145e79ad055b32dd740dd, user_id=82e8d294c4c64f8584bbc6b442d5b26c, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.746931 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226fedd-d4bf-4354-9b3c-05d37e7f43b5 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.762547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 977/1964] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:17 2022] PUT /identity/v3/projects/29a895181fb145e79ad055b32dd740dd/users/82e8d294c4c64f8584bbc6b442d5b26c/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:17.773924 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e5997-69ee-450a-90ff-3ab62d86ef72 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.774333 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e5997-69ee-450a-90ff-3ab62d86ef72 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.774538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e5997-69ee-450a-90ff-3ab62d86ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.803012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-8a4e5997-69ee-450a-90ff-3ab62d86ef72 None None] MFA Rules not processed for user `82e8d294c4c64f8584bbc6b442d5b26c`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:17.804209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-8a4e5997-69ee-450a-90ff-3ab62d86ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:17.831482 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226fedd-d4bf-4354-9b3c-05d37e7f43b5 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.875192 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 988/1965] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:17.886968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e5997-69ee-450a-90ff-3ab62d86ef72 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:17.888384 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-8a4e5997-69ee-450a-90ff-3ab62d86ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:17.892999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226fedd-d4bf-4354-9b3c-05d37e7f43b5 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.896753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1d7d4-8051-490a-b74f-cec12604bc03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.897312 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1d7d4-8051-490a-b74f-cec12604bc03 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.897590 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1d7d4-8051-490a-b74f-cec12604bc03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.897863 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1d7d4-8051-490a-b74f-cec12604bc03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.899642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-46d1d7d4-8051-490a-b74f-cec12604bc03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:17.900427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e5997-69ee-450a-90ff-3ab62d86ef72 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:17.903968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19360e5d-9067-4f5c-b3f4-d576a5901d26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:17.904575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19360e5d-9067-4f5c-b3f4-d576a5901d26 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:17.904855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19360e5d-9067-4f5c-b3f4-d576a5901d26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:17.905130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19360e5d-9067-4f5c-b3f4-d576a5901d26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:17.913991 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19360e5d-9067-4f5c-b3f4-d576a5901d26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.915439 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19360e5d-9067-4f5c-b3f4-d576a5901d26 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.923023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:17.924342 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 989/1966] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:17.963039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1d7d4-8051-490a-b74f-cec12604bc03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:17.964487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1d7d4-8051-490a-b74f-cec12604bc03 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:17.974404 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 978/1967] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:22.565183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d95adf-cb94-4733-ab49-d2049af6d064 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:22.565673 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d95adf-cb94-4733-ab49-d2049af6d064 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:22.565847 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d95adf-cb94-4733-ab49-d2049af6d064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:22.584951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-f7d95adf-cb94-4733-ab49-d2049af6d064 None None] MFA Rules not processed for user `82e8d294c4c64f8584bbc6b442d5b26c`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:22.586186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f7d95adf-cb94-4733-ab49-d2049af6d064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:22.593018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 990/1968] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:27.901083 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1d7d4-8051-490a-b74f-cec12604bc03 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:27.903474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-46d1d7d4-8051-490a-b74f-cec12604bc03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:27.972057 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1d7d4-8051-490a-b74f-cec12604bc03 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:27.977173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992d252-0792-4bbf-a1b0-d7aa2ea5384b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:27.977826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d252-0792-4bbf-a1b0-d7aa2ea5384b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:27.978175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d252-0792-4bbf-a1b0-d7aa2ea5384b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:27.978443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992d252-0792-4bbf-a1b0-d7aa2ea5384b admin admin] PATH_INFO: `/v3/users/e444b13dc34d4e7c9f4fad7d11ddb811` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:27.979575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992d252-0792-4bbf-a1b0-d7aa2ea5384b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e444b13dc34d4e7c9f4fad7d11ddb811)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:27.981763 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992d252-0792-4bbf-a1b0-d7aa2ea5384b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:28.035560 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9992d252-0792-4bbf-a1b0-d7aa2ea5384b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e444b13dc34d4e7c9f4fad7d11ddb811'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:28.036363 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9992d252-0792-4bbf-a1b0-d7aa2ea5384b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e444b13dc34d4e7c9f4fad7d11ddb811'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:28.045112 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9992d252-0792-4bbf-a1b0-d7aa2ea5384b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e444b13dc34d4e7c9f4fad7d11ddb811'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:28.053908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d95adf-cb94-4733-ab49-d2049af6d064 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:28.063290 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9992d252-0792-4bbf-a1b0-d7aa2ea5384b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e444b13dc34d4e7c9f4fad7d11ddb811'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:28.064239 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9992d252-0792-4bbf-a1b0-d7aa2ea5384b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e444b13dc34d4e7c9f4fad7d11ddb811'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:28.065630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d95adf-cb94-4733-ab49-d2049af6d064 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:28.070898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:28.071524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:28.071803 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:28.072077 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] PATH_INFO: `/v3/users/852674a0902b4c328fbebbb945a98639` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:28.073479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852674a0902b4c328fbebbb945a98639)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:28.075583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:28.082538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 979/1969] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:27 2022] DELETE /identity/v3/users/e444b13dc34d4e7c9f4fad7d11ddb811 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:28.086767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b89b8-b6c0-47a2-8184-4d08751d4b40 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:28.087048 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b89b8-b6c0-47a2-8184-4d08751d4b40 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:28.087324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b89b8-b6c0-47a2-8184-4d08751d4b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:28.106544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-8e2b89b8-b6c0-47a2-8184-4d08751d4b40 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:28.107937 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8e2b89b8-b6c0-47a2-8184-4d08751d4b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:28.118036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:28.130241 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852674a0902b4c328fbebbb945a98639'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:28.138090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852674a0902b4c328fbebbb945a98639'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:28.147522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:28.150776 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852674a0902b4c328fbebbb945a98639'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:28.151651 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852674a0902b4c328fbebbb945a98639'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:28.168786 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852674a0902b4c328fbebbb945a98639'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:28.173642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 980/1970] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:28.178581 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 991/1971] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:28 2022] DELETE /identity/v3/users/852674a0902b4c328fbebbb945a98639 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:28.182867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da901-eb95-473b-af52-df4d82383e47 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:28.183188 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da901-eb95-473b-af52-df4d82383e47 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:28.183397 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:28.183517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da901-eb95-473b-af52-df4d82383e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:28.184731 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:28.203664 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-700da901-eb95-473b-af52-df4d82383e47 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:28.205396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-700da901-eb95-473b-af52-df4d82383e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:28.244147 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cfb74-0f81-4093-841c-9e787e459fc4 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:28.248024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1686cc-a7ae-4eb7-948e-cc7ecc0a68d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:28.248654 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1686cc-a7ae-4eb7-948e-cc7ecc0a68d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:28.248939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1686cc-a7ae-4eb7-948e-cc7ecc0a68d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:28.249218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1686cc-a7ae-4eb7-948e-cc7ecc0a68d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:28.263053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 981/1972] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:28.273656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700da901-eb95-473b-af52-df4d82383e47 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:28.285011 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700da901-eb95-473b-af52-df4d82383e47 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:28.289311 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570031b-c8e7-4f24-b184-be4a5e82369d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:28.290156 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570031b-c8e7-4f24-b184-be4a5e82369d service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:28.290519 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570031b-c8e7-4f24-b184-be4a5e82369d service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:28.290871 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570031b-c8e7-4f24-b184-be4a5e82369d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:28.302725 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570031b-c8e7-4f24-b184-be4a5e82369d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:28.304238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570031b-c8e7-4f24-b184-be4a5e82369d service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:28.315593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 982/1973] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:28.326397 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1686cc-a7ae-4eb7-948e-cc7ecc0a68d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:28.329300 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1686cc-a7ae-4eb7-948e-cc7ecc0a68d9 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:28.342699 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 992/1974] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:29.387880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570031b-c8e7-4f24-b184-be4a5e82369d service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:29.389377 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4570031b-c8e7-4f24-b184-be4a5e82369d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:29.435855 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570031b-c8e7-4f24-b184-be4a5e82369d service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:29.452826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:29.454344 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:29.454836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:29.457146 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] PATH_INFO: `/v3/projects/3743d4bf565c46a0bf93b18e154576af` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:29.461984 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3743d4bf565c46a0bf93b18e154576af)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:29.464145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:29.559343 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1686cc-a7ae-4eb7-948e-cc7ecc0a68d9 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:29.561408 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3a1686cc-a7ae-4eb7-948e-cc7ecc0a68d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:29.607619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1686cc-a7ae-4eb7-948e-cc7ecc0a68d9 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:29.621218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:29.622781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:29.623305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:29.623889 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] PATH_INFO: `/v3/projects/829ef8fdde244636b02dd24925625643` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:29.626825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=829ef8fdde244636b02dd24925625643)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:29.632015 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:29.666212 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3743d4bf565c46a0bf93b18e154576af', 'request_id': 'req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:29.679435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3743d4bf565c46a0bf93b18e154576af', 'request_id': 'req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:29.691386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3743d4bf565c46a0bf93b18e154576af', 'request_id': 'req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:29.715053 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] The token cache is being invalidate because project 3743d4bf565c46a0bf93b18e154576af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:29.715431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:29.716278 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:29.718455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 983/1975] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:29 2022] DELETE /identity/v3/projects/3743d4bf565c46a0bf93b18e154576af => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:29.722262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:29.733975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:29.747060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829ef8fdde244636b02dd24925625643', 'request_id': 'req-bc93131a-d933-4491-b420-1185f8cfa37f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:29.764802 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829ef8fdde244636b02dd24925625643', 'request_id': 'req-bc93131a-d933-4491-b420-1185f8cfa37f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:29.768534 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:29.774697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829ef8fdde244636b02dd24925625643', 'request_id': 'req-bc93131a-d933-4491-b420-1185f8cfa37f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:29.804303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] The token cache is being invalidate because project 829ef8fdde244636b02dd24925625643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:29.806244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:29.807307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:29.811590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 993/1976] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:29 2022] DELETE /identity/v3/projects/829ef8fdde244636b02dd24925625643 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:29.816160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:29.818878 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:29.877157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:29.904898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e95eb-7543-4a30-b875-9db6dd6b72fc admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:29.916362 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:29.917131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:29.917462 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:29.917809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] PATH_INFO: `/v3/users/84523beb0c75429a99514d754443da99` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:29.919208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84523beb0c75429a99514d754443da99)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:29.922317 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:29.924809 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93131a-d933-4491-b420-1185f8cfa37f admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:29.932898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846bf04c-93ab-421f-a468-649995422baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:29.933762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bf04c-93ab-421f-a468-649995422baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:29.934068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bf04c-93ab-421f-a468-649995422baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:29.934355 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bf04c-93ab-421f-a468-649995422baf admin admin] PATH_INFO: `/v3/users/db1475cbce5a4b2b92515ae9a657037b` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:29.935542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846bf04c-93ab-421f-a468-649995422baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1475cbce5a4b2b92515ae9a657037b)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:29.937499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846bf04c-93ab-421f-a468-649995422baf admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:29.998719 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84523beb0c75429a99514d754443da99'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:29.999756 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84523beb0c75429a99514d754443da99'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.011059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84523beb0c75429a99514d754443da99'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.011494 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-846bf04c-93ab-421f-a468-649995422baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1475cbce5a4b2b92515ae9a657037b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.019792 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-846bf04c-93ab-421f-a468-649995422baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1475cbce5a4b2b92515ae9a657037b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.029742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-846bf04c-93ab-421f-a468-649995422baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1475cbce5a4b2b92515ae9a657037b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.030452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84523beb0c75429a99514d754443da99'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.030936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-846bf04c-93ab-421f-a468-649995422baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1475cbce5a4b2b92515ae9a657037b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.031293 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84523beb0c75429a99514d754443da99'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.049899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 984/1977] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:29 2022] DELETE /identity/v3/users/84523beb0c75429a99514d754443da99 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:30.056072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-846bf04c-93ab-421f-a468-649995422baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1475cbce5a4b2b92515ae9a657037b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.065286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 994/1978] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:29 2022] DELETE /identity/v3/users/db1475cbce5a4b2b92515ae9a657037b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:30.461214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:30.463819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:30.591480 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70f4fb-86c9-49eb-9c64-6b4a8ccd6112 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:30.693767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:30.694752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:30.694894 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:30.695337 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] PATH_INFO: `/v3/projects/492ca5110ff2478fa6e94ee38df26463` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:30.696713 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=492ca5110ff2478fa6e94ee38df26463)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:30.698866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:30.735140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:30.767691 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492ca5110ff2478fa6e94ee38df26463', 'request_id': 'req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.778804 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492ca5110ff2478fa6e94ee38df26463', 'request_id': 'req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.787335 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492ca5110ff2478fa6e94ee38df26463', 'request_id': 'req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.802947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] The token cache is being invalidate because project 492ca5110ff2478fa6e94ee38df26463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:30.803315 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.804062 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9061f840-2d2c-4f4e-9d18-d0b53f7ceb05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:30.809015 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 985/1979] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:30 2022] DELETE /identity/v3/projects/492ca5110ff2478fa6e94ee38df26463 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:30.813915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760309cc-e266-4109-8270-aa6de025aa75 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:30.814339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760309cc-e266-4109-8270-aa6de025aa75 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:30.814507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760309cc-e266-4109-8270-aa6de025aa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:30.835844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-760309cc-e266-4109-8270-aa6de025aa75 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:30.837148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-760309cc-e266-4109-8270-aa6de025aa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:30.957145 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 995/1980] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:30.958449 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f118f1-242d-4498-93fd-44295282e1b0 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:30.958746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f118f1-242d-4498-93fd-44295282e1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:30.959027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f118f1-242d-4498-93fd-44295282e1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:30.998063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-c5f118f1-242d-4498-93fd-44295282e1b0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:30.999244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c5f118f1-242d-4498-93fd-44295282e1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:31.008850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 986/1981] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:31.017466 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760309cc-e266-4109-8270-aa6de025aa75 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.029294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:31.034115 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760309cc-e266-4109-8270-aa6de025aa75 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:31.043289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df286f97-5b62-47b3-871b-cda603ccab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:31.044790 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df286f97-5b62-47b3-871b-cda603ccab7c admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.045241 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df286f97-5b62-47b3-871b-cda603ccab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.045809 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df286f97-5b62-47b3-871b-cda603ccab7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.046824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df286f97-5b62-47b3-871b-cda603ccab7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:31.048722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df286f97-5b62-47b3-871b-cda603ccab7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:31.051754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df286f97-5b62-47b3-871b-cda603ccab7c admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:31.072237 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 996/1982] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:31.076003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f118f1-242d-4498-93fd-44295282e1b0 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.087419 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f118f1-242d-4498-93fd-44295282e1b0 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:31.103326 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4a80b-4487-4ae0-89f5-518146ee71e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:31.103683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4a80b-4487-4ae0-89f5-518146ee71e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.103971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4a80b-4487-4ae0-89f5-518146ee71e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.104247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4a80b-4487-4ae0-89f5-518146ee71e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.104958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4a80b-4487-4ae0-89f5-518146ee71e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:31.114315 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4a80b-4487-4ae0-89f5-518146ee71e4 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:31.173811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 987/1983] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:31 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:31.178580 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df286f97-5b62-47b3-871b-cda603ccab7c admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.193018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df286f97-5b62-47b3-871b-cda603ccab7c admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:31.295447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4a80b-4487-4ae0-89f5-518146ee71e4 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.298455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e2c4a80b-4487-4ae0-89f5-518146ee71e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:31.308904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f50fd-628b-4f55-bfbd-9e8d77941087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:31.309885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f50fd-628b-4f55-bfbd-9e8d77941087 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.311346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f50fd-628b-4f55-bfbd-9e8d77941087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.311697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f50fd-628b-4f55-bfbd-9e8d77941087 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.313040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f50fd-628b-4f55-bfbd-9e8d77941087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:31.319860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f50fd-628b-4f55-bfbd-9e8d77941087 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:31.354126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 997/1984] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:31 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:31.354126 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f50fd-628b-4f55-bfbd-9e8d77941087 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.368557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f50fd-628b-4f55-bfbd-9e8d77941087 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:31.376883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda9f58-6c5a-43ab-91f7-571d963f0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:31.377558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda9f58-6c5a-43ab-91f7-571d963f0c6b admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.377846 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda9f58-6c5a-43ab-91f7-571d963f0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.378166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda9f58-6c5a-43ab-91f7-571d963f0c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.379007 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda9f58-6c5a-43ab-91f7-571d963f0c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:31.381840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda9f58-6c5a-43ab-91f7-571d963f0c6b admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:31.397818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 998/1985] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:31.402520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda9f58-6c5a-43ab-91f7-571d963f0c6b admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.413351 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda9f58-6c5a-43ab-91f7-571d963f0c6b admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:31.419367 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5608d-1420-41f6-8589-710c1ae9676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:31.420417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5608d-1420-41f6-8589-710c1ae9676a admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.420989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5608d-1420-41f6-8589-710c1ae9676a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.421153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5608d-1420-41f6-8589-710c1ae9676a admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.421839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5608d-1420-41f6-8589-710c1ae9676a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:31.423504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5608d-1420-41f6-8589-710c1ae9676a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:31.434731 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 999/1986] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:31.437023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4a80b-4487-4ae0-89f5-518146ee71e4 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:31.438922 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5608d-1420-41f6-8589-710c1ae9676a admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.443328 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:31.444126 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.444474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.444833 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] PATH_INFO: `/v3/projects/4e7a5146c5dd45dc910c12b9a4792d32` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.446210 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7a5146c5dd45dc910c12b9a4792d32)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:31.448414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:31.450645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5608d-1420-41f6-8589-710c1ae9676a admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:31.456160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d22a94-c4a5-41f6-b4b4-0642f4f0fb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:31.456478 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d22a94-c4a5-41f6-b4b4-0642f4f0fb6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.456672 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d22a94-c4a5-41f6-b4b4-0642f4f0fb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.458171 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d22a94-c4a5-41f6-b4b4-0642f4f0fb6c admin admin] PATH_INFO: `/v3/projects/2820322f97ba4c3b9ce46cc0f2ae2074/users/7f89fe3e4862452e8679356459515eca/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.475169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d22a94-c4a5-41f6-b4b4-0642f4f0fb6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2820322f97ba4c3b9ce46cc0f2ae2074, user_id=7f89fe3e4862452e8679356459515eca, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:31.477880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d22a94-c4a5-41f6-b4b4-0642f4f0fb6c admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:31.493838 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1000/1987] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:31 2022] PUT /identity/v3/projects/2820322f97ba4c3b9ce46cc0f2ae2074/users/7f89fe3e4862452e8679356459515eca/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:31.505683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a557a50-20dd-4bdc-a544-e5f8d22207c7 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.506042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a557a50-20dd-4bdc-a544-e5f8d22207c7 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.506898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a557a50-20dd-4bdc-a544-e5f8d22207c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.510695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7a5146c5dd45dc910c12b9a4792d32', 'request_id': 'req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:31.518268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7a5146c5dd45dc910c12b9a4792d32', 'request_id': 'req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:31.525021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7a5146c5dd45dc910c12b9a4792d32', 'request_id': 'req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:31.540290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-1a557a50-20dd-4bdc-a544-e5f8d22207c7 None None] MFA Rules not processed for user `7f89fe3e4862452e8679356459515eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:31.541588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1a557a50-20dd-4bdc-a544-e5f8d22207c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:31.546919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] The token cache is being invalidate because project 4e7a5146c5dd45dc910c12b9a4792d32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:31.547863 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:31.548668 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-fd7caa8e-95ac-43ed-a8af-557ea74dd67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:31.550175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 988/1988] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:31 2022] DELETE /identity/v3/projects/4e7a5146c5dd45dc910c12b9a4792d32 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:31.555035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf88a6-dc59-4132-bdd5-b72a3bd08fd2 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.555421 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf88a6-dc59-4132-bdd5-b72a3bd08fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.555700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf88a6-dc59-4132-bdd5-b72a3bd08fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.581967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-60cf88a6-dc59-4132-bdd5-b72a3bd08fd2 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:31.584361 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-60cf88a6-dc59-4132-bdd5-b72a3bd08fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:31.590961 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:31.634282 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1001/1989] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:31.650585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a557a50-20dd-4bdc-a544-e5f8d22207c7 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.654850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1a557a50-20dd-4bdc-a544-e5f8d22207c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:31.681642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 989/1990] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:31.691091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d234-1389-49e4-8d41-198235a8abeb None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.691378 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d234-1389-49e4-8d41-198235a8abeb None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.691659 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927d234-1389-49e4-8d41-198235a8abeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.710705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:31.726339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3927d234-1389-49e4-8d41-198235a8abeb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:31.727625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3927d234-1389-49e4-8d41-198235a8abeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:31.743850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 990/1991] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:31.746402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927d234-1389-49e4-8d41-198235a8abeb None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.759509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927d234-1389-49e4-8d41-198235a8abeb None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:31.767294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae03b-c266-4091-a31b-34be353c7411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:31.767493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a557a50-20dd-4bdc-a544-e5f8d22207c7 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:31.768445 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae03b-c266-4091-a31b-34be353c7411 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.768903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae03b-c266-4091-a31b-34be353c7411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.769510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae03b-c266-4091-a31b-34be353c7411 admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.770558 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae03b-c266-4091-a31b-34be353c7411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:31.771591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae03b-c266-4091-a31b-34be353c7411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:31.773589 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae03b-c266-4091-a31b-34be353c7411 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:31.777816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3641045-7189-44df-8e04-8d714e7cd8cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:31.778601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3641045-7189-44df-8e04-8d714e7cd8cb service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.779036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3641045-7189-44df-8e04-8d714e7cd8cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.779277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3641045-7189-44df-8e04-8d714e7cd8cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.796524 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 991/1992] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:31.798184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3641045-7189-44df-8e04-8d714e7cd8cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:31.798618 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae03b-c266-4091-a31b-34be353c7411 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.799817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3641045-7189-44df-8e04-8d714e7cd8cb service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:31.825072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1002/1993] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:31.833100 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae03b-c266-4091-a31b-34be353c7411 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:31.851373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3641045-7189-44df-8e04-8d714e7cd8cb service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.854763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f3641045-7189-44df-8e04-8d714e7cd8cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:31.862163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762552d2-1143-42f9-baee-1e20e5d449ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:31.862820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762552d2-1143-42f9-baee-1e20e5d449ea admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.863075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762552d2-1143-42f9-baee-1e20e5d449ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.863350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762552d2-1143-42f9-baee-1e20e5d449ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.865848 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762552d2-1143-42f9-baee-1e20e5d449ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:31.867828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762552d2-1143-42f9-baee-1e20e5d449ea admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:31.887022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3641045-7189-44df-8e04-8d714e7cd8cb service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:31.893415 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d9097-55ed-4571-bfe8-1f3180f2bfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:31.894452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d9097-55ed-4571-bfe8-1f3180f2bfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:31.894868 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d9097-55ed-4571-bfe8-1f3180f2bfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:31.895282 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d9097-55ed-4571-bfe8-1f3180f2bfd4 admin admin] PATH_INFO: `/v3/users/7f89fe3e4862452e8679356459515eca` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:31.896783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d9097-55ed-4571-bfe8-1f3180f2bfd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f89fe3e4862452e8679356459515eca)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:31.899083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d9097-55ed-4571-bfe8-1f3180f2bfd4 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:31.948530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 992/1994] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:31 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:31.950443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762552d2-1143-42f9-baee-1e20e5d449ea admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:31.974337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ff5d9097-55ed-4571-bfe8-1f3180f2bfd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f89fe3e4862452e8679356459515eca'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:31.984575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ff5d9097-55ed-4571-bfe8-1f3180f2bfd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f89fe3e4862452e8679356459515eca'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:32.002904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ff5d9097-55ed-4571-bfe8-1f3180f2bfd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f89fe3e4862452e8679356459515eca'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:32.003698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ff5d9097-55ed-4571-bfe8-1f3180f2bfd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f89fe3e4862452e8679356459515eca'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:32.029542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ff5d9097-55ed-4571-bfe8-1f3180f2bfd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f89fe3e4862452e8679356459515eca'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:32.054258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1003/1995] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:31 2022] DELETE /identity/v3/users/7f89fe3e4862452e8679356459515eca => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:32.059582 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677e181-c20f-4a15-8fe7-c8ae7f065208 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:32.059896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677e181-c20f-4a15-8fe7-c8ae7f065208 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:32.060195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677e181-c20f-4a15-8fe7-c8ae7f065208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:32.099281 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-1677e181-c20f-4a15-8fe7-c8ae7f065208 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:32.100533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1677e181-c20f-4a15-8fe7-c8ae7f065208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:32.103658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762552d2-1143-42f9-baee-1e20e5d449ea admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:32.204430 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1004/1996] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:32.230591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b784c92-658c-49fd-8efc-45d01f605897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:32.231760 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b784c92-658c-49fd-8efc-45d01f605897 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:32.232322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b784c92-658c-49fd-8efc-45d01f605897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:32.232823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b784c92-658c-49fd-8efc-45d01f605897 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:32.233221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677e181-c20f-4a15-8fe7-c8ae7f065208 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:32.234556 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b784c92-658c-49fd-8efc-45d01f605897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:32.237551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b784c92-658c-49fd-8efc-45d01f605897 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:32.243943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1677e181-c20f-4a15-8fe7-c8ae7f065208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:32.271071 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 993/1997] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:31 2022] POST /identity/v3/users => generated 294 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:32.272267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b784c92-658c-49fd-8efc-45d01f605897 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:32.274584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-5b784c92-658c-49fd-8efc-45d01f605897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:32.294965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b784c92-658c-49fd-8efc-45d01f605897 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:32.309711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7f9a7-83c8-4647-bebb-75a6d6d78cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:32.312111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7f9a7-83c8-4647-bebb-75a6d6d78cec admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:32.312507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7f9a7-83c8-4647-bebb-75a6d6d78cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:32.313505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7f9a7-83c8-4647-bebb-75a6d6d78cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:32.314284 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7f9a7-83c8-4647-bebb-75a6d6d78cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:32.318276 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7f9a7-83c8-4647-bebb-75a6d6d78cec admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:32.320966 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:32.341915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:32.355269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 994/1998] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:32.356329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7f9a7-83c8-4647-bebb-75a6d6d78cec admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:32.371182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677e181-c20f-4a15-8fe7-c8ae7f065208 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:32.374701 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7f9a7-83c8-4647-bebb-75a6d6d78cec admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:32.375553 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6d2ae-b468-4211-90ff-0289dcf4d431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:32.376301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d2ae-b468-4211-90ff-0289dcf4d431 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:32.376593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d2ae-b468-4211-90ff-0289dcf4d431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:32.376932 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d2ae-b468-4211-90ff-0289dcf4d431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:32.382769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8ed8-0cab-4b5e-811d-4c5897274496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:32.383749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8ed8-0cab-4b5e-811d-4c5897274496 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:32.384551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8ed8-0cab-4b5e-811d-4c5897274496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:32.385030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8ed8-0cab-4b5e-811d-4c5897274496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:32.386103 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8ed8-0cab-4b5e-811d-4c5897274496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:32.388741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6d2ae-b468-4211-90ff-0289dcf4d431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:32.390556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6d2ae-b468-4211-90ff-0289dcf4d431 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:32.391217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8ed8-0cab-4b5e-811d-4c5897274496 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:32.405569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1005/1999] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:32.406056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 995/2000] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:32.410227 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6d2ae-b468-4211-90ff-0289dcf4d431 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:32.426883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6d2ae-b468-4211-90ff-0289dcf4d431 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:32.432962 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc069c-844b-482d-b812-5f7cda8d627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:32.433697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc069c-844b-482d-b812-5f7cda8d627e admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:32.433996 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc069c-844b-482d-b812-5f7cda8d627e admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:32.434817 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc069c-844b-482d-b812-5f7cda8d627e admin admin] PATH_INFO: `/v3/projects/c927b9085014420696a25791d48a4498/users/2c7525f872824fc38ad79c6b4fd4e508/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:32.460269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc069c-844b-482d-b812-5f7cda8d627e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c927b9085014420696a25791d48a4498, user_id=2c7525f872824fc38ad79c6b4fd4e508, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:32.463592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc069c-844b-482d-b812-5f7cda8d627e admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:32.491173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1006/2001] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:32 2022] PUT /identity/v3/projects/c927b9085014420696a25791d48a4498/users/2c7525f872824fc38ad79c6b4fd4e508/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:32.501441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be71d7-2804-4205-87ec-c9a77c847664 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:32.501738 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be71d7-2804-4205-87ec-c9a77c847664 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:32.502115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be71d7-2804-4205-87ec-c9a77c847664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:32.556034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-22be71d7-2804-4205-87ec-c9a77c847664 None None] MFA Rules not processed for user `2c7525f872824fc38ad79c6b4fd4e508`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:32.558841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-22be71d7-2804-4205-87ec-c9a77c847664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:32.646590 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 996/2002] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:32.651361 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc069c-844b-482d-b812-5f7cda8d627e admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:32.851055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc069c-844b-482d-b812-5f7cda8d627e admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:32.863027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cf198-5daa-426a-b3d2-4910c506966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:32.863796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cf198-5daa-426a-b3d2-4910c506966f admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:32.864143 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cf198-5daa-426a-b3d2-4910c506966f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:32.864550 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cf198-5daa-426a-b3d2-4910c506966f admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:32.865594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cf198-5daa-426a-b3d2-4910c506966f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:32.867947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cf198-5daa-426a-b3d2-4910c506966f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:32.935664 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1007/2003] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:32 2022] POST /identity/v3/projects => generated 383 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:32.942114 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be71d7-2804-4205-87ec-c9a77c847664 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:32.968247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be71d7-2804-4205-87ec-c9a77c847664 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:33.112985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95194653-3370-497d-9a2c-0031afec1093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:33.114425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95194653-3370-497d-9a2c-0031afec1093 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.115340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95194653-3370-497d-9a2c-0031afec1093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.116012 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95194653-3370-497d-9a2c-0031afec1093 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:33.116691 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95194653-3370-497d-9a2c-0031afec1093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:33.120155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95194653-3370-497d-9a2c-0031afec1093 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:33.150392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 997/2004] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:32 2022] POST /identity/v3/users => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:33.154450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cf198-5daa-426a-b3d2-4910c506966f admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:33.171798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cf198-5daa-426a-b3d2-4910c506966f admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:33.177325 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc613a4-cd62-43ae-b19a-091969d2cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:33.178350 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc613a4-cd62-43ae-b19a-091969d2cd24 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.178576 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc613a4-cd62-43ae-b19a-091969d2cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.178850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc613a4-cd62-43ae-b19a-091969d2cd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:33.179660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc613a4-cd62-43ae-b19a-091969d2cd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:33.181967 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc613a4-cd62-43ae-b19a-091969d2cd24 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:33.196856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1008/2005] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:33.198093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95194653-3370-497d-9a2c-0031afec1093 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:33.214844 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95194653-3370-497d-9a2c-0031afec1093 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:33.221307 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddadda-421b-4e79-b83d-c2bee9d121aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:33.222565 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddadda-421b-4e79-b83d-c2bee9d121aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.223080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddadda-421b-4e79-b83d-c2bee9d121aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.223563 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddadda-421b-4e79-b83d-c2bee9d121aa admin admin] PATH_INFO: `/v3/projects/a7508309301f46f28bf305009156cf7b/users/dac584f8f6b84443923168251334b932/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:33.242880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddadda-421b-4e79-b83d-c2bee9d121aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7508309301f46f28bf305009156cf7b, user_id=dac584f8f6b84443923168251334b932, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:33.246134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddadda-421b-4e79-b83d-c2bee9d121aa admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:33.270385 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 998/2006] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:33 2022] PUT /identity/v3/projects/a7508309301f46f28bf305009156cf7b/users/dac584f8f6b84443923168251334b932/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:33.271680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc613a4-cd62-43ae-b19a-091969d2cd24 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:33.283579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc613a4-cd62-43ae-b19a-091969d2cd24 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:33.347272 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbb65d-f461-4497-90e8-185995e88317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:33.347611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb65d-f461-4497-90e8-185995e88317 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.347864 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb65d-f461-4497-90e8-185995e88317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.348040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb65d-f461-4497-90e8-185995e88317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:33.354085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbb65d-f461-4497-90e8-185995e88317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:33.354085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbb65d-f461-4497-90e8-185995e88317 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:33.366317 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1009/2007] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:33.368242 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddadda-421b-4e79-b83d-c2bee9d121aa admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:33.379933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddadda-421b-4e79-b83d-c2bee9d121aa admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:33.389763 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85326b4a-4d8c-40a9-aedf-278443e5b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:33.390752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85326b4a-4d8c-40a9-aedf-278443e5b52c admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.391031 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85326b4a-4d8c-40a9-aedf-278443e5b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.391311 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85326b4a-4d8c-40a9-aedf-278443e5b52c admin admin] PATH_INFO: `/v3/projects/a7508309301f46f28bf305009156cf7b/users/dac584f8f6b84443923168251334b932/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:33.393774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85326b4a-4d8c-40a9-aedf-278443e5b52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7508309301f46f28bf305009156cf7b, user_id=dac584f8f6b84443923168251334b932, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:33.397118 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85326b4a-4d8c-40a9-aedf-278443e5b52c admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:33.409311 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 999/2008] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:33 2022] PUT /identity/v3/projects/a7508309301f46f28bf305009156cf7b/users/dac584f8f6b84443923168251334b932/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:33.421069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a85e9a-0ba6-411c-a013-8f888a2c4017 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.421348 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a85e9a-0ba6-411c-a013-8f888a2c4017 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.421781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a85e9a-0ba6-411c-a013-8f888a2c4017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:33.441121 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85326b4a-4d8c-40a9-aedf-278443e5b52c admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:33.444869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-85326b4a-4d8c-40a9-aedf-278443e5b52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:33.455307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-55a85e9a-0ba6-411c-a013-8f888a2c4017 None None] MFA Rules not processed for user `dac584f8f6b84443923168251334b932`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:33.456538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-55a85e9a-0ba6-411c-a013-8f888a2c4017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:33.479499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:33.507283 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:33.559390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1010/2009] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:33.572339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a85e9a-0ba6-411c-a013-8f888a2c4017 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:33.573739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-55a85e9a-0ba6-411c-a013-8f888a2c4017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:33.584471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85326b4a-4d8c-40a9-aedf-278443e5b52c admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:33.596586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:33.597255 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.597593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.597809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] PATH_INFO: `/v3/projects/2820322f97ba4c3b9ce46cc0f2ae2074` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:33.603034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2820322f97ba4c3b9ce46cc0f2ae2074)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:33.604952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:33.666555 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2820322f97ba4c3b9ce46cc0f2ae2074', 'request_id': 'req-098438e6-6100-4030-a6d4-e601dd8f25c0'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:33.673168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2820322f97ba4c3b9ce46cc0f2ae2074', 'request_id': 'req-098438e6-6100-4030-a6d4-e601dd8f25c0'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:33.681470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2820322f97ba4c3b9ce46cc0f2ae2074', 'request_id': 'req-098438e6-6100-4030-a6d4-e601dd8f25c0'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:33.695268 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a85e9a-0ba6-411c-a013-8f888a2c4017 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:33.700170 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] The token cache is being invalidate because project 2820322f97ba4c3b9ce46cc0f2ae2074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:33.700474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:33.701166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-098438e6-6100-4030-a6d4-e601dd8f25c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:33.704448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1000/2010] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:33 2022] DELETE /identity/v3/projects/2820322f97ba4c3b9ce46cc0f2ae2074 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:33.711259 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fc527-3464-48bc-971d-2a8bc950e59f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.711569 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fc527-3464-48bc-971d-2a8bc950e59f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.711838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fc527-3464-48bc-971d-2a8bc950e59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:33.780346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6044c-ef9a-41e6-9c80-9e20e3f93fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:33.781445 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6044c-ef9a-41e6-9c80-9e20e3f93fba service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.781445 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6044c-ef9a-41e6-9c80-9e20e3f93fba service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.781738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6044c-ef9a-41e6-9c80-9e20e3f93fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:33.785034 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-33b6044c-ef9a-41e6-9c80-9e20e3f93fba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:33.793561 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-a93fc527-3464-48bc-971d-2a8bc950e59f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:33.795131 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-a93fc527-3464-48bc-971d-2a8bc950e59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:33.857812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6044c-ef9a-41e6-9c80-9e20e3f93fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:33.859996 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6044c-ef9a-41e6-9c80-9e20e3f93fba service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:33.876712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1001/2011] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:33.878161 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1011/2012] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:33.884761 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91999af-3d2e-4ada-9c00-d1f3941d9ca0 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.885046 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91999af-3d2e-4ada-9c00-d1f3941d9ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.885349 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91999af-3d2e-4ada-9c00-d1f3941d9ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:33.913570 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-c91999af-3d2e-4ada-9c00-d1f3941d9ca0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:33.914812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c91999af-3d2e-4ada-9c00-d1f3941d9ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:33.923179 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1002/2013] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:33.928099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6044c-ef9a-41e6-9c80-9e20e3f93fba service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:33.939234 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6044c-ef9a-41e6-9c80-9e20e3f93fba service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:33.946334 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ed321-c96e-4ae4-be64-1f3f7fe59d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:33.947143 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ed321-c96e-4ae4-be64-1f3f7fe59d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.947755 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ed321-c96e-4ae4-be64-1f3f7fe59d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.948235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ed321-c96e-4ae4-be64-1f3f7fe59d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:33.949314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ed321-c96e-4ae4-be64-1f3f7fe59d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:33.949627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ed321-c96e-4ae4-be64-1f3f7fe59d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:33.953874 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ed321-c96e-4ae4-be64-1f3f7fe59d14 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:33.974430 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1012/2014] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:33.976501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91999af-3d2e-4ada-9c00-d1f3941d9ca0 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:33.990440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91999af-3d2e-4ada-9c00-d1f3941d9ca0 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:33.995578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc312136-a2a2-4ae8-aa19-e64f014c8a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:33.996206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc312136-a2a2-4ae8-aa19-e64f014c8a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:33.996483 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc312136-a2a2-4ae8-aa19-e64f014c8a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:33.996755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc312136-a2a2-4ae8-aa19-e64f014c8a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:34.002215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc312136-a2a2-4ae8-aa19-e64f014c8a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:34.002215 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc312136-a2a2-4ae8-aa19-e64f014c8a0a admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:34.033429 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1003/2015] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:33 2022] POST /identity/v3/projects => generated 359 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:34.037586 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ed321-c96e-4ae4-be64-1f3f7fe59d14 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:34.050733 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ed321-c96e-4ae4-be64-1f3f7fe59d14 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:34.055524 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:34.136100 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d76a29-3638-4a88-8422-d0852b682a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:34.137106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d76a29-3638-4a88-8422-d0852b682a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:34.137579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d76a29-3638-4a88-8422-d0852b682a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:34.138058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d76a29-3638-4a88-8422-d0852b682a69 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:34.139186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d76a29-3638-4a88-8422-d0852b682a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:34.141745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d76a29-3638-4a88-8422-d0852b682a69 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:34.172001 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1013/2016] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:34 2022] POST /identity/v3/users => generated 280 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:34.175976 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc312136-a2a2-4ae8-aa19-e64f014c8a0a admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:34.189252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc312136-a2a2-4ae8-aa19-e64f014c8a0a admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:34.195535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0a120-0241-4e68-9c4a-e601bdac4485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:34.196263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0a120-0241-4e68-9c4a-e601bdac4485 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:34.196548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0a120-0241-4e68-9c4a-e601bdac4485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:34.196828 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0a120-0241-4e68-9c4a-e601bdac4485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:34.197652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0a120-0241-4e68-9c4a-e601bdac4485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:34.199396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0a120-0241-4e68-9c4a-e601bdac4485 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:34.211933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1004/2017] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:34.216207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d76a29-3638-4a88-8422-d0852b682a69 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:34.228480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d76a29-3638-4a88-8422-d0852b682a69 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:34.233761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a25dca-bbdb-4da2-b5d4-e9a159a69c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:34.234654 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a25dca-bbdb-4da2-b5d4-e9a159a69c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:34.235027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a25dca-bbdb-4da2-b5d4-e9a159a69c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:34.235446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a25dca-bbdb-4da2-b5d4-e9a159a69c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:34.236416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a25dca-bbdb-4da2-b5d4-e9a159a69c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:34.238247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a25dca-bbdb-4da2-b5d4-e9a159a69c44 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:34.256428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0a120-0241-4e68-9c4a-e601bdac4485 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:34.257036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1014/2018] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:34.271334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0a120-0241-4e68-9c4a-e601bdac4485 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:34.290369 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6001654-29d1-4caf-9610-f8871eb8f365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:34.292872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6001654-29d1-4caf-9610-f8871eb8f365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:34.293343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6001654-29d1-4caf-9610-f8871eb8f365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:34.296346 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6001654-29d1-4caf-9610-f8871eb8f365 admin admin] PATH_INFO: `/v3/projects/c9cfb5cfd08d4811a29d813f07f0c997/users/ff1d702e37774bf281bc22196098d095/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:34.339424 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6001654-29d1-4caf-9610-f8871eb8f365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9cfb5cfd08d4811a29d813f07f0c997, user_id=ff1d702e37774bf281bc22196098d095, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:34.342523 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6001654-29d1-4caf-9610-f8871eb8f365 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:34.348674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:34.377586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1005/2019] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:34 2022] PUT /identity/v3/projects/c9cfb5cfd08d4811a29d813f07f0c997/users/ff1d702e37774bf281bc22196098d095/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:34.388858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567a90-26d9-4979-ae39-86ec064f9fbf None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:34.389148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567a90-26d9-4979-ae39-86ec064f9fbf None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:34.389609 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc567a90-26d9-4979-ae39-86ec064f9fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:34.448635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-cc567a90-26d9-4979-ae39-86ec064f9fbf None None] MFA Rules not processed for user `ff1d702e37774bf281bc22196098d095`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:34.450870 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-cc567a90-26d9-4979-ae39-86ec064f9fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:34.612552 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1015/2020] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:34.657075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6001654-29d1-4caf-9610-f8871eb8f365 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:34.658999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d6001654-29d1-4caf-9610-f8871eb8f365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:34.674813 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567a90-26d9-4979-ae39-86ec064f9fbf None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:34.676433 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-cc567a90-26d9-4979-ae39-86ec064f9fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:34.754398 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6001654-29d1-4caf-9610-f8871eb8f365 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:34.760089 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc7283-07aa-40c3-8ced-6ca3d88cc1ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:34.761279 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc7283-07aa-40c3-8ced-6ca3d88cc1ec service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:34.761790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc7283-07aa-40c3-8ced-6ca3d88cc1ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:34.762206 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc7283-07aa-40c3-8ced-6ca3d88cc1ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:34.775663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc7283-07aa-40c3-8ced-6ca3d88cc1ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:34.777623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc7283-07aa-40c3-8ced-6ca3d88cc1ec service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:34.779841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc567a90-26d9-4979-ae39-86ec064f9fbf None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:34.784902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31eabf-986d-495f-ba13-d91578a04050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:34.786357 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31eabf-986d-495f-ba13-d91578a04050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:34.787090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31eabf-986d-495f-ba13-d91578a04050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:34.787386 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31eabf-986d-495f-ba13-d91578a04050 admin admin] PATH_INFO: `/v3/users/2c7525f872824fc38ad79c6b4fd4e508` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:34.788686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31eabf-986d-495f-ba13-d91578a04050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c7525f872824fc38ad79c6b4fd4e508)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:34.790691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31eabf-986d-495f-ba13-d91578a04050 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:34.792599 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1006/2021] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:34.811977 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc7283-07aa-40c3-8ced-6ca3d88cc1ec service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:34.823916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:34.826968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc7283-07aa-40c3-8ced-6ca3d88cc1ec service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:34.837396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c905136-2673-46b0-939e-45822b77ab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:34.838589 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c905136-2673-46b0-939e-45822b77ab6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:34.839363 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c905136-2673-46b0-939e-45822b77ab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:34.839540 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c905136-2673-46b0-939e-45822b77ab6b admin admin] PATH_INFO: `/v3/users/ff1d702e37774bf281bc22196098d095` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:34.842594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c905136-2673-46b0-939e-45822b77ab6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1d702e37774bf281bc22196098d095)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:34.844758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c905136-2673-46b0-939e-45822b77ab6b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:34.895917 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-0b31eabf-986d-495f-ba13-d91578a04050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c7525f872824fc38ad79c6b4fd4e508'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:34.906283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-0b31eabf-986d-495f-ba13-d91578a04050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c7525f872824fc38ad79c6b4fd4e508'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:34.920396 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-0b31eabf-986d-495f-ba13-d91578a04050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c7525f872824fc38ad79c6b4fd4e508'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:34.921220 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-0b31eabf-986d-495f-ba13-d91578a04050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c7525f872824fc38ad79c6b4fd4e508'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:34.931267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-6c905136-2673-46b0-939e-45822b77ab6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1d702e37774bf281bc22196098d095'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:34.931966 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-6c905136-2673-46b0-939e-45822b77ab6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1d702e37774bf281bc22196098d095'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:34.939470 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-0b31eabf-986d-495f-ba13-d91578a04050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c7525f872824fc38ad79c6b4fd4e508'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:34.942066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-6c905136-2673-46b0-939e-45822b77ab6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1d702e37774bf281bc22196098d095'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:34.946702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1016/2022] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:34 2022] DELETE /identity/v3/users/2c7525f872824fc38ad79c6b4fd4e508 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:34.951078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72740-85df-4ed6-b8cc-b3262a25c4e3 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:34.951461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72740-85df-4ed6-b8cc-b3262a25c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:34.951823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e72740-85df-4ed6-b8cc-b3262a25c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:34.961325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-6c905136-2673-46b0-939e-45822b77ab6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1d702e37774bf281bc22196098d095'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:34.962202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-6c905136-2673-46b0-939e-45822b77ab6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1d702e37774bf281bc22196098d095'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:34.977044 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-a5e72740-85df-4ed6-b8cc-b3262a25c4e3 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:34.978309 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-a5e72740-85df-4ed6-b8cc-b3262a25c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:34.991687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1007/2023] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:34 2022] DELETE /identity/v3/users/ff1d702e37774bf281bc22196098d095 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:34.993689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba81c3e-eab9-4d47-b798-8b7f0f555613 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:34.993981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba81c3e-eab9-4d47-b798-8b7f0f555613 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:34.994521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba81c3e-eab9-4d47-b798-8b7f0f555613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:35.021297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6ba81c3e-eab9-4d47-b798-8b7f0f555613 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:35.022845 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6ba81c3e-eab9-4d47-b798-8b7f0f555613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:35.073059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1017/2024] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:35.087986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e72740-85df-4ed6-b8cc-b3262a25c4e3 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:35.089527 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-a5e72740-85df-4ed6-b8cc-b3262a25c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:35.118402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1008/2025] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:35.130037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba81c3e-eab9-4d47-b798-8b7f0f555613 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:35.132251 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6ba81c3e-eab9-4d47-b798-8b7f0f555613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:35.151502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:35.188051 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e72740-85df-4ed6-b8cc-b3262a25c4e3 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:35.218837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba81c3e-eab9-4d47-b798-8b7f0f555613 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:35.222952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a1aca-87bf-4f69-b2c8-03351399bbba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:35.223599 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a1aca-87bf-4f69-b2c8-03351399bbba service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:35.224406 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a1aca-87bf-4f69-b2c8-03351399bbba service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:35.224682 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a1aca-87bf-4f69-b2c8-03351399bbba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:35.236805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a1aca-87bf-4f69-b2c8-03351399bbba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:35.238472 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a1aca-87bf-4f69-b2c8-03351399bbba service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:35.252243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1009/2026] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:35.266834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d1da5-61d5-44b6-b825-eb9cfd5f0cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:35.267664 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d1da5-61d5-44b6-b825-eb9cfd5f0cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:35.268103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d1da5-61d5-44b6-b825-eb9cfd5f0cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:35.268652 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d1da5-61d5-44b6-b825-eb9cfd5f0cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:35.276604 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:35.284875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d1da5-61d5-44b6-b825-eb9cfd5f0cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:35.287913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d1da5-61d5-44b6-b825-eb9cfd5f0cd0 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:35.308719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1018/2027] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:35.663517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a1aca-87bf-4f69-b2c8-03351399bbba service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:35.665032 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-542a1aca-87bf-4f69-b2c8-03351399bbba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:35.679056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a1aca-87bf-4f69-b2c8-03351399bbba service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:35.684954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:35.685670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:35.685965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:35.686272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] PATH_INFO: `/v3/projects/c9cfb5cfd08d4811a29d813f07f0c997` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:35.687456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9cfb5cfd08d4811a29d813f07f0c997)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:35.689371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:35.725718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d1da5-61d5-44b6-b825-eb9cfd5f0cd0 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:35.727442 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b93d1da5-61d5-44b6-b825-eb9cfd5f0cd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:35.741802 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d1da5-61d5-44b6-b825-eb9cfd5f0cd0 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:35.753675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9cfb5cfd08d4811a29d813f07f0c997', 'request_id': 'req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:35.760765 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9cfb5cfd08d4811a29d813f07f0c997', 'request_id': 'req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:35.767011 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9cfb5cfd08d4811a29d813f07f0c997', 'request_id': 'req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:35.780385 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] The token cache is being invalidate because project c9cfb5cfd08d4811a29d813f07f0c997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:35.780758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:35.781312 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a4cc829a-8cbf-4c54-81b1-e0eb93ebb1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:35.782861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1010/2028] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:35 2022] DELETE /identity/v3/projects/c9cfb5cfd08d4811a29d813f07f0c997 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:35.788161 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a645eb8-5b2b-47de-ad38-be14b9209795 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:35.788454 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a645eb8-5b2b-47de-ad38-be14b9209795 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:35.788732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a645eb8-5b2b-47de-ad38-be14b9209795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:35.806588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:35.807322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:35.807606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:35.807884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] PATH_INFO: `/v3/projects/c927b9085014420696a25791d48a4498` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:35.809062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c927b9085014420696a25791d48a4498)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:35.809420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-1a645eb8-5b2b-47de-ad38-be14b9209795 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:35.810819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-1a645eb8-5b2b-47de-ad38-be14b9209795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:35.811062 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:35.818968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1011/2029] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:35.827834 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d5942-02c0-4216-9a0f-f1af10612986 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:35.828367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d5942-02c0-4216-9a0f-f1af10612986 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:35.828367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d5942-02c0-4216-9a0f-f1af10612986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:35.851930 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-956d5942-02c0-4216-9a0f-f1af10612986 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:35.853167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-956d5942-02c0-4216-9a0f-f1af10612986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:35.865770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c927b9085014420696a25791d48a4498', 'request_id': 'req-6cc2f598-3489-4f5f-ad35-486d21f49e3b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:35.872731 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c927b9085014420696a25791d48a4498', 'request_id': 'req-6cc2f598-3489-4f5f-ad35-486d21f49e3b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:35.880133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c927b9085014420696a25791d48a4498', 'request_id': 'req-6cc2f598-3489-4f5f-ad35-486d21f49e3b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:35.899014 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] The token cache is being invalidate because project c927b9085014420696a25791d48a4498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:35.899646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:35.900018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:35.901567 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1019/2030] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:35 2022] DELETE /identity/v3/projects/c927b9085014420696a25791d48a4498 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:35.905603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:35.907354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:35.935695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1012/2031] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:35.939967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d5942-02c0-4216-9a0f-f1af10612986 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:35.951650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d5942-02c0-4216-9a0f-f1af10612986 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:35.956736 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977bffd-533a-44c7-ae78-13f8cfc68ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:35.957584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977bffd-533a-44c7-ae78-13f8cfc68ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:35.958142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977bffd-533a-44c7-ae78-13f8cfc68ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:35.959072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977bffd-533a-44c7-ae78-13f8cfc68ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:35.960015 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977bffd-533a-44c7-ae78-13f8cfc68ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:35.960473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977bffd-533a-44c7-ae78-13f8cfc68ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:35.962245 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977bffd-533a-44c7-ae78-13f8cfc68ffd admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:35.975527 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1013/2032] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:24:35.980154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977bffd-533a-44c7-ae78-13f8cfc68ffd admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:35.987317 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2f598-3489-4f5f-ad35-486d21f49e3b admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:35.991093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977bffd-533a-44c7-ae78-13f8cfc68ffd admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:35.993038 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:35.993754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:35.994136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:35.994596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] PATH_INFO: `/v3/users/dac584f8f6b84443923168251334b932` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:35.995674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac584f8f6b84443923168251334b932)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:35.996583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a945363-78ba-4911-a4e1-9f11898b37e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:35.997401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a945363-78ba-4911-a4e1-9f11898b37e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:35.997619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:35.998112 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a945363-78ba-4911-a4e1-9f11898b37e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:35.998582 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a945363-78ba-4911-a4e1-9f11898b37e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:35.999438 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a945363-78ba-4911-a4e1-9f11898b37e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:36.001580 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a945363-78ba-4911-a4e1-9f11898b37e5 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:36.028406 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:36.035560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:36.043373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1014/2033] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:35 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:36.047783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a945363-78ba-4911-a4e1-9f11898b37e5 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:36.070360 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac584f8f6b84443923168251334b932'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:36.079397 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac584f8f6b84443923168251334b932'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:36.092689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac584f8f6b84443923168251334b932'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:36.097806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac584f8f6b84443923168251334b932'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:36.113840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac584f8f6b84443923168251334b932'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:36.122104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1020/2034] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:35 2022] DELETE /identity/v3/users/dac584f8f6b84443923168251334b932 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:36.123236 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a945363-78ba-4911-a4e1-9f11898b37e5 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:36.185941 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f7d80-949c-4d05-a51f-b413e659ebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:36.186882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f7d80-949c-4d05-a51f-b413e659ebaf admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.186882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f7d80-949c-4d05-a51f-b413e659ebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.187134 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f7d80-949c-4d05-a51f-b413e659ebaf admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.187804 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f7d80-949c-4d05-a51f-b413e659ebaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:36.189714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f7d80-949c-4d05-a51f-b413e659ebaf admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:36.213002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1015/2035] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:36 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:36.217005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:36.218891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:36.234363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d516c71-f4e0-4cb2-a6c4-28ef413298ac admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:36.239963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c28f8c-e528-4f68-b5dd-f95c09250d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:36.240823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c28f8c-e528-4f68-b5dd-f95c09250d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.246457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c28f8c-e528-4f68-b5dd-f95c09250d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.246765 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c28f8c-e528-4f68-b5dd-f95c09250d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.247561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c28f8c-e528-4f68-b5dd-f95c09250d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:36.249232 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c28f8c-e528-4f68-b5dd-f95c09250d46 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:36.280073 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1021/2036] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:36.283856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f7d80-949c-4d05-a51f-b413e659ebaf admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:36.295584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f7d80-949c-4d05-a51f-b413e659ebaf admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:36.300870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0a8df-7c65-467a-9936-18152ead7705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:36.301506 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0a8df-7c65-467a-9936-18152ead7705 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.301824 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0a8df-7c65-467a-9936-18152ead7705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.302140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0a8df-7c65-467a-9936-18152ead7705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.302974 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0a8df-7c65-467a-9936-18152ead7705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:36.304603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0a8df-7c65-467a-9936-18152ead7705 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:36.320263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1016/2037] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:36.324222 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c28f8c-e528-4f68-b5dd-f95c09250d46 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:36.335986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c28f8c-e528-4f68-b5dd-f95c09250d46 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:36.341387 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd8a7-3617-4ee1-a38a-9ca660b4a242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:36.342243 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd8a7-3617-4ee1-a38a-9ca660b4a242 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.342548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd8a7-3617-4ee1-a38a-9ca660b4a242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.342825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd8a7-3617-4ee1-a38a-9ca660b4a242 admin admin] PATH_INFO: `/v3/projects/7faeb26874b44279bbe4c40a7d689767/users/8edfeed052314bbfa75bc96204de6632/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.360915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd8a7-3617-4ee1-a38a-9ca660b4a242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7faeb26874b44279bbe4c40a7d689767, user_id=8edfeed052314bbfa75bc96204de6632, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:36.364585 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd8a7-3617-4ee1-a38a-9ca660b4a242 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:36.381296 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1022/2038] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:36 2022] PUT /identity/v3/projects/7faeb26874b44279bbe4c40a7d689767/users/8edfeed052314bbfa75bc96204de6632/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:36.394757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cbd19-8f82-457b-8ab4-2e7197250057 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.395144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cbd19-8f82-457b-8ab4-2e7197250057 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.395440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cbd19-8f82-457b-8ab4-2e7197250057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.432777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-8e6cbd19-8f82-457b-8ab4-2e7197250057 None None] MFA Rules not processed for user `8edfeed052314bbfa75bc96204de6632`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:36.434035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8e6cbd19-8f82-457b-8ab4-2e7197250057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:36.501321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd8a7-3617-4ee1-a38a-9ca660b4a242 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:36.503247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-bb5dd8a7-3617-4ee1-a38a-9ca660b4a242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:36.555453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1017/2039] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:36.569263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cbd19-8f82-457b-8ab4-2e7197250057 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:36.571074 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8e6cbd19-8f82-457b-8ab4-2e7197250057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:36.584469 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:36.585288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd8a7-3617-4ee1-a38a-9ca660b4a242 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:36.592605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:36.593276 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.593562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.593927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] PATH_INFO: `/v3/projects/a7508309301f46f28bf305009156cf7b` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.595091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7508309301f46f28bf305009156cf7b)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:36.596999 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:36.640806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cbd19-8f82-457b-8ab4-2e7197250057 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:36.655433 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7508309301f46f28bf305009156cf7b', 'request_id': 'req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:36.662135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7508309301f46f28bf305009156cf7b', 'request_id': 'req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:36.667754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7508309301f46f28bf305009156cf7b', 'request_id': 'req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:36.676211 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:36.682238 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] The token cache is being invalidate because project a7508309301f46f28bf305009156cf7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:36.683179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:36.684116 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-2be32fdb-82cb-4f77-a55d-4ca014b87b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:36.689736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1023/2040] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:36 2022] DELETE /identity/v3/projects/a7508309301f46f28bf305009156cf7b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:36.691263 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc75103-1197-468c-a87b-f0ece5b46a32 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.691555 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc75103-1197-468c-a87b-f0ece5b46a32 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.691830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc75103-1197-468c-a87b-f0ece5b46a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.692204 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1e704-9d5f-4725-a245-9f79f9f4bc38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:36.693309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1e704-9d5f-4725-a245-9f79f9f4bc38 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.693590 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1e704-9d5f-4725-a245-9f79f9f4bc38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.693856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1e704-9d5f-4725-a245-9f79f9f4bc38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.695643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-83f1e704-9d5f-4725-a245-9f79f9f4bc38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:36.719193 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-7dc75103-1197-468c-a87b-f0ece5b46a32 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:36.720425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7dc75103-1197-468c-a87b-f0ece5b46a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:36.756782 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1e704-9d5f-4725-a245-9f79f9f4bc38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:36.758253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1e704-9d5f-4725-a245-9f79f9f4bc38 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:36.768078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1018/2041] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:36.781543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1024/2042] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:36.791367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158c700-29f2-4c13-9797-981a4eb90cb5 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.791758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158c700-29f2-4c13-9797-981a4eb90cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.792529 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158c700-29f2-4c13-9797-981a4eb90cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.817041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-1158c700-29f2-4c13-9797-981a4eb90cb5 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:36.818779 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-1158c700-29f2-4c13-9797-981a4eb90cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:36.827405 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1019/2043] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:36.831666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc75103-1197-468c-a87b-f0ece5b46a32 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:36.843030 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc75103-1197-468c-a87b-f0ece5b46a32 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:36.848413 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca014f5c-e554-4558-8f02-b5e8931b0cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:36.849040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca014f5c-e554-4558-8f02-b5e8931b0cac admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.849315 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca014f5c-e554-4558-8f02-b5e8931b0cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.849587 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca014f5c-e554-4558-8f02-b5e8931b0cac admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.850311 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca014f5c-e554-4558-8f02-b5e8931b0cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:36.850614 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca014f5c-e554-4558-8f02-b5e8931b0cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:36.852188 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca014f5c-e554-4558-8f02-b5e8931b0cac admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:36.864070 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1025/2044] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:36.868763 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158c700-29f2-4c13-9797-981a4eb90cb5 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:36.878968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158c700-29f2-4c13-9797-981a4eb90cb5 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:36.885178 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56e240-574d-438f-aac1-d0d361e54dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:36.886093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56e240-574d-438f-aac1-d0d361e54dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.886546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56e240-574d-438f-aac1-d0d361e54dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.886913 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56e240-574d-438f-aac1-d0d361e54dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.887677 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56e240-574d-438f-aac1-d0d361e54dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:36.890473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56e240-574d-438f-aac1-d0d361e54dc2 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:36.922184 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1020/2045] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:36 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:36.923594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca014f5c-e554-4558-8f02-b5e8931b0cac admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:36.934146 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca014f5c-e554-4558-8f02-b5e8931b0cac admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:36.997219 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72933536-fbd9-4f25-ba96-0af5abb44d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:36.997865 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72933536-fbd9-4f25-ba96-0af5abb44d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:36.998176 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72933536-fbd9-4f25-ba96-0af5abb44d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:36.998453 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72933536-fbd9-4f25-ba96-0af5abb44d19 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:36.999129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72933536-fbd9-4f25-ba96-0af5abb44d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:37.001033 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72933536-fbd9-4f25-ba96-0af5abb44d19 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:37.024984 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1026/2046] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:36 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:37.029080 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56e240-574d-438f-aac1-d0d361e54dc2 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:37.043016 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56e240-574d-438f-aac1-d0d361e54dc2 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:37.048489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9ae1-7831-4ed4-a595-4bf981227c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:37.049321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9ae1-7831-4ed4-a595-4bf981227c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.049650 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9ae1-7831-4ed4-a595-4bf981227c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.050041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9ae1-7831-4ed4-a595-4bf981227c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.050664 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9ae1-7831-4ed4-a595-4bf981227c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:37.052913 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9ae1-7831-4ed4-a595-4bf981227c68 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:37.063505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1021/2047] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:37.068215 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72933536-fbd9-4f25-ba96-0af5abb44d19 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:37.094579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72933536-fbd9-4f25-ba96-0af5abb44d19 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:37.102333 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60bde2-dd0e-4083-86c0-dc898093b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:37.106515 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60bde2-dd0e-4083-86c0-dc898093b1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.106863 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60bde2-dd0e-4083-86c0-dc898093b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.107145 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60bde2-dd0e-4083-86c0-dc898093b1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.108067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60bde2-dd0e-4083-86c0-dc898093b1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:37.109876 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60bde2-dd0e-4083-86c0-dc898093b1e0 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:37.125926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1027/2048] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:37.127516 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9ae1-7831-4ed4-a595-4bf981227c68 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:37.151183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9ae1-7831-4ed4-a595-4bf981227c68 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:37.166586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73da7dd-c6c3-4da5-9605-cce7f16c0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:37.167299 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73da7dd-c6c3-4da5-9605-cce7f16c0e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.167578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73da7dd-c6c3-4da5-9605-cce7f16c0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.167859 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73da7dd-c6c3-4da5-9605-cce7f16c0e6a admin admin] PATH_INFO: `/v3/projects/c6a39bfe9fa34cf38e7e534fc8ee780a/users/589593e992ac40438564c07e35f6975a/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.198178 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73da7dd-c6c3-4da5-9605-cce7f16c0e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6a39bfe9fa34cf38e7e534fc8ee780a, user_id=589593e992ac40438564c07e35f6975a, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:37.200872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73da7dd-c6c3-4da5-9605-cce7f16c0e6a admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:37.216191 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1022/2049] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:37 2022] PUT /identity/v3/projects/c6a39bfe9fa34cf38e7e534fc8ee780a/users/589593e992ac40438564c07e35f6975a/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:37.226517 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ef39-326a-40c4-9b68-e5ef073f65be None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.226808 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ef39-326a-40c4-9b68-e5ef073f65be None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.227085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270ef39-326a-40c4-9b68-e5ef073f65be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.259670 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-3270ef39-326a-40c4-9b68-e5ef073f65be None None] MFA Rules not processed for user `589593e992ac40438564c07e35f6975a`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:37.260913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3270ef39-326a-40c4-9b68-e5ef073f65be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:37.327204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:37.342514 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1028/2050] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:37.343618 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73da7dd-c6c3-4da5-9605-cce7f16c0e6a admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:37.365656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:37.420779 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73da7dd-c6c3-4da5-9605-cce7f16c0e6a admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:37.425473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fe474-c693-4efc-9701-24a5ff61403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:37.426148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe474-c693-4efc-9701-24a5ff61403b admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.426440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe474-c693-4efc-9701-24a5ff61403b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.427306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fe474-c693-4efc-9701-24a5ff61403b admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.428023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fe474-c693-4efc-9701-24a5ff61403b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:37.430000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fe474-c693-4efc-9701-24a5ff61403b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:37.459251 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1023/2051] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:37 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:37.460643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ef39-326a-40c4-9b68-e5ef073f65be None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:37.476435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270ef39-326a-40c4-9b68-e5ef073f65be None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:37.540509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496e6d3-cabc-4f8d-b49b-30db8e55db5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:37.541145 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e6d3-cabc-4f8d-b49b-30db8e55db5d admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.541429 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e6d3-cabc-4f8d-b49b-30db8e55db5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.541706 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e6d3-cabc-4f8d-b49b-30db8e55db5d admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.542421 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496e6d3-cabc-4f8d-b49b-30db8e55db5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:37.544376 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496e6d3-cabc-4f8d-b49b-30db8e55db5d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:37.567180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1029/2052] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:37 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:37.571119 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fe474-c693-4efc-9701-24a5ff61403b admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:37.581579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fe474-c693-4efc-9701-24a5ff61403b admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:37.591430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6b3c6-8d07-4218-8586-a1a3154438e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:37.592130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6b3c6-8d07-4218-8586-a1a3154438e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.592406 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6b3c6-8d07-4218-8586-a1a3154438e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.592683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6b3c6-8d07-4218-8586-a1a3154438e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.593393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6b3c6-8d07-4218-8586-a1a3154438e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:37.595052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6b3c6-8d07-4218-8586-a1a3154438e8 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:37.607352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1024/2053] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:37.611497 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496e6d3-cabc-4f8d-b49b-30db8e55db5d admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:37.623075 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496e6d3-cabc-4f8d-b49b-30db8e55db5d admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:37.630995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65364f-0651-4650-928c-c1d05a985769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:37.631675 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65364f-0651-4650-928c-c1d05a985769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.631957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65364f-0651-4650-928c-c1d05a985769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.632230 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65364f-0651-4650-928c-c1d05a985769 admin admin] PATH_INFO: `/v3/projects/b59e74a37c50431ba16f3adf7f36b834/users/46a2414e52bd4134a30d594738ab68ac/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.647890 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65364f-0651-4650-928c-c1d05a985769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59e74a37c50431ba16f3adf7f36b834, user_id=46a2414e52bd4134a30d594738ab68ac, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:37.650562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65364f-0651-4650-928c-c1d05a985769 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:37.664573 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1030/2054] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:37 2022] PUT /identity/v3/projects/b59e74a37c50431ba16f3adf7f36b834/users/46a2414e52bd4134a30d594738ab68ac/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:37.668544 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6b3c6-8d07-4218-8586-a1a3154438e8 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:37.679232 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6b3c6-8d07-4218-8586-a1a3154438e8 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:37.744175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb04e9-6c70-41c4-ba2e-1da5c6735ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:37.744826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb04e9-6c70-41c4-ba2e-1da5c6735ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.744979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb04e9-6c70-41c4-ba2e-1da5c6735ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.745257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb04e9-6c70-41c4-ba2e-1da5c6735ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.745957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb04e9-6c70-41c4-ba2e-1da5c6735ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:37.747646 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb04e9-6c70-41c4-ba2e-1da5c6735ff7 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:37.758056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1025/2055] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:37.762253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65364f-0651-4650-928c-c1d05a985769 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:37.773388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65364f-0651-4650-928c-c1d05a985769 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:37.777982 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16100ef-2014-4629-8624-4995e17d2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:37.778950 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16100ef-2014-4629-8624-4995e17d2ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.779236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16100ef-2014-4629-8624-4995e17d2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.779514 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16100ef-2014-4629-8624-4995e17d2ed2 admin admin] PATH_INFO: `/v3/projects/b59e74a37c50431ba16f3adf7f36b834/users/46a2414e52bd4134a30d594738ab68ac/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.781484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16100ef-2014-4629-8624-4995e17d2ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59e74a37c50431ba16f3adf7f36b834, user_id=46a2414e52bd4134a30d594738ab68ac, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:37.784157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16100ef-2014-4629-8624-4995e17d2ed2 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:37.795569 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1031/2056] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:37 2022] PUT /identity/v3/projects/b59e74a37c50431ba16f3adf7f36b834/users/46a2414e52bd4134a30d594738ab68ac/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:37.806655 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ac9fd-5ff7-42c2-8dea-a71bb42ed904 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.806966 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ac9fd-5ff7-42c2-8dea-a71bb42ed904 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.807243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ac9fd-5ff7-42c2-8dea-a71bb42ed904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.835015 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-d56ac9fd-5ff7-42c2-8dea-a71bb42ed904 None None] MFA Rules not processed for user `46a2414e52bd4134a30d594738ab68ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:37.836214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d56ac9fd-5ff7-42c2-8dea-a71bb42ed904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:37.903643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1026/2057] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:37.915391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16100ef-2014-4629-8624-4995e17d2ed2 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:37.917134 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c16100ef-2014-4629-8624-4995e17d2ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:37.976093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16100ef-2014-4629-8624-4995e17d2ed2 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:37.980118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf0e23-b747-4607-82f4-50a05ceadb60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:37.980698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf0e23-b747-4607-82f4-50a05ceadb60 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:37.980980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf0e23-b747-4607-82f4-50a05ceadb60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:37.981597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf0e23-b747-4607-82f4-50a05ceadb60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:37.992394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf0e23-b747-4607-82f4-50a05ceadb60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:37.994287 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf0e23-b747-4607-82f4-50a05ceadb60 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:38.004230 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1032/2058] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:38.408801 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ac9fd-5ff7-42c2-8dea-a71bb42ed904 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:38.426715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:38.484933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ac9fd-5ff7-42c2-8dea-a71bb42ed904 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:38.489913 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:38.490619 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:38.490907 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:38.491214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] PATH_INFO: `/v3/users/589593e992ac40438564c07e35f6975a` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:38.492396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=589593e992ac40438564c07e35f6975a)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:38.494615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:38.562194 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589593e992ac40438564c07e35f6975a'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:38.562998 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589593e992ac40438564c07e35f6975a'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:38.572617 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589593e992ac40438564c07e35f6975a'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:38.587138 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589593e992ac40438564c07e35f6975a'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:38.588052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589593e992ac40438564c07e35f6975a'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:38.601306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1027/2059] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:38 2022] DELETE /identity/v3/users/589593e992ac40438564c07e35f6975a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:38.605818 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b057ce5-ae1f-4bb5-8bd3-02eeee5d1a19 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:38.606135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b057ce5-ae1f-4bb5-8bd3-02eeee5d1a19 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:38.606446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b057ce5-ae1f-4bb5-8bd3-02eeee5d1a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:38.625985 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-5b057ce5-ae1f-4bb5-8bd3-02eeee5d1a19 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:38.627248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5b057ce5-ae1f-4bb5-8bd3-02eeee5d1a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:38.681235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:38.701462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1033/2060] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:38.711653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:38.713064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:38.787127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ce10-2af0-4f95-a3e6-cc7701674679 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:38.790838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6d6bf-2266-4497-b104-a08019d7ad2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:38.791431 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d6bf-2266-4497-b104-a08019d7ad2d service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:38.791726 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d6bf-2266-4497-b104-a08019d7ad2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:38.791999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6d6bf-2266-4497-b104-a08019d7ad2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:38.803689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6d6bf-2266-4497-b104-a08019d7ad2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:38.805126 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6d6bf-2266-4497-b104-a08019d7ad2d service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:38.815225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1028/2061] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:39.087128 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b057ce5-ae1f-4bb5-8bd3-02eeee5d1a19 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:39.095336 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5b057ce5-ae1f-4bb5-8bd3-02eeee5d1a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:39.122530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b057ce5-ae1f-4bb5-8bd3-02eeee5d1a19 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:39.128625 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:39.129661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:39.130079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:39.130558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] PATH_INFO: `/v3/projects/c6a39bfe9fa34cf38e7e534fc8ee780a` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:39.132012 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6a39bfe9fa34cf38e7e534fc8ee780a)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:39.134072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:39.210595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6a39bfe9fa34cf38e7e534fc8ee780a', 'request_id': 'req-7bffe937-d8ba-4a82-b9a3-b1035538a159'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:39.219655 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6a39bfe9fa34cf38e7e534fc8ee780a', 'request_id': 'req-7bffe937-d8ba-4a82-b9a3-b1035538a159'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:39.228130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6a39bfe9fa34cf38e7e534fc8ee780a', 'request_id': 'req-7bffe937-d8ba-4a82-b9a3-b1035538a159'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:39.247359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] The token cache is being invalidate because project c6a39bfe9fa34cf38e7e534fc8ee780a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:39.247726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:39.248520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:39.250645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1034/2062] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:39 2022] DELETE /identity/v3/projects/c6a39bfe9fa34cf38e7e534fc8ee780a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:39.254391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6d6bf-2266-4497-b104-a08019d7ad2d service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:39.267418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6d6bf-2266-4497-b104-a08019d7ad2d service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:39.308968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:39.360742 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6d755-74d0-47bd-8d97-b9013c708865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:39.361965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6d755-74d0-47bd-8d97-b9013c708865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:39.362513 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6d755-74d0-47bd-8d97-b9013c708865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:39.363443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6d755-74d0-47bd-8d97-b9013c708865 admin admin] PATH_INFO: `/v3/users/46a2414e52bd4134a30d594738ab68ac` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:39.364695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6d755-74d0-47bd-8d97-b9013c708865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a2414e52bd4134a30d594738ab68ac)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:39.368449 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6d755-74d0-47bd-8d97-b9013c708865 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:39.429888 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-16a6d755-74d0-47bd-8d97-b9013c708865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a2414e52bd4134a30d594738ab68ac'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:39.430902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-16a6d755-74d0-47bd-8d97-b9013c708865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a2414e52bd4134a30d594738ab68ac'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:39.441674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-16a6d755-74d0-47bd-8d97-b9013c708865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a2414e52bd4134a30d594738ab68ac'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:39.460018 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-16a6d755-74d0-47bd-8d97-b9013c708865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a2414e52bd4134a30d594738ab68ac'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:39.461024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-16a6d755-74d0-47bd-8d97-b9013c708865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a2414e52bd4134a30d594738ab68ac'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:39.490491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1029/2063] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:39 2022] DELETE /identity/v3/users/46a2414e52bd4134a30d594738ab68ac => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:39.882904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:39.884452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:39.901722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffe937-d8ba-4a82-b9a3-b1035538a159 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:39.979701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:39.980288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:39.981275 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:39.982042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] PATH_INFO: `/v3/projects/b59e74a37c50431ba16f3adf7f36b834` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:39.983963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59e74a37c50431ba16f3adf7f36b834)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:39.986187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:40.071757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59e74a37c50431ba16f3adf7f36b834', 'request_id': 'req-f8b32259-8c1e-4f20-95d4-e4117f9d7111'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:40.084262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59e74a37c50431ba16f3adf7f36b834', 'request_id': 'req-f8b32259-8c1e-4f20-95d4-e4117f9d7111'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:40.090575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59e74a37c50431ba16f3adf7f36b834', 'request_id': 'req-f8b32259-8c1e-4f20-95d4-e4117f9d7111'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:40.103907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] The token cache is being invalidate because project b59e74a37c50431ba16f3adf7f36b834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:40.104193 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:40.104828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-f8b32259-8c1e-4f20-95d4-e4117f9d7111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:40.106388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1035/2064] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:39 2022] DELETE /identity/v3/projects/b59e74a37c50431ba16f3adf7f36b834 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:40.111397 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812ea27-a088-40e6-bc18-7377e223b88f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:40.111872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812ea27-a088-40e6-bc18-7377e223b88f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:40.111997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812ea27-a088-40e6-bc18-7377e223b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:40.135615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6812ea27-a088-40e6-bc18-7377e223b88f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:40.136790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6812ea27-a088-40e6-bc18-7377e223b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:40.213845 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1030/2065] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:40.222462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8ee9-7296-432d-b289-ef8773b201d9 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:40.222829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8ee9-7296-432d-b289-ef8773b201d9 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:40.223236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8ee9-7296-432d-b289-ef8773b201d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:40.232107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:40.253710 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-c8ce8ee9-7296-432d-b289-ef8773b201d9 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:40.255742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c8ce8ee9-7296-432d-b289-ef8773b201d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:40.264148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1036/2066] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:40.269135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812ea27-a088-40e6-bc18-7377e223b88f None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:40.297373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812ea27-a088-40e6-bc18-7377e223b88f None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:40.319975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe462d4-f9e0-4b99-888b-44b2ce4d16f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:40.320847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe462d4-f9e0-4b99-888b-44b2ce4d16f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:40.321124 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe462d4-f9e0-4b99-888b-44b2ce4d16f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:40.321394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe462d4-f9e0-4b99-888b-44b2ce4d16f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:40.322373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe462d4-f9e0-4b99-888b-44b2ce4d16f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:40.323193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe462d4-f9e0-4b99-888b-44b2ce4d16f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:40.324825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe462d4-f9e0-4b99-888b-44b2ce4d16f8 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:40.341936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1031/2067] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:24:40.343932 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce8ee9-7296-432d-b289-ef8773b201d9 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:40.357291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce8ee9-7296-432d-b289-ef8773b201d9 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:40.366462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef6ba5-a5c9-4365-8667-db0a09603de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:40.367280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef6ba5-a5c9-4365-8667-db0a09603de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:40.367666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef6ba5-a5c9-4365-8667-db0a09603de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:40.368108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef6ba5-a5c9-4365-8667-db0a09603de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:40.369058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef6ba5-a5c9-4365-8667-db0a09603de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:40.371366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef6ba5-a5c9-4365-8667-db0a09603de7 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:40.401193 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1037/2068] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:40 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:40.405705 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe462d4-f9e0-4b99-888b-44b2ce4d16f8 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:40.416929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe462d4-f9e0-4b99-888b-44b2ce4d16f8 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:40.456164 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:40.476975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150bff1-9fa1-4bc7-af46-194bf951931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:40.477602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150bff1-9fa1-4bc7-af46-194bf951931f admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:40.477914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150bff1-9fa1-4bc7-af46-194bf951931f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:40.478220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150bff1-9fa1-4bc7-af46-194bf951931f admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:40.478900 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150bff1-9fa1-4bc7-af46-194bf951931f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:40.480802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150bff1-9fa1-4bc7-af46-194bf951931f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:40.503108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1032/2069] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:40 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:40.508200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef6ba5-a5c9-4365-8667-db0a09603de7 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:40.518690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef6ba5-a5c9-4365-8667-db0a09603de7 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:40.523301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1912da4-dd45-4ba0-a40e-031f0b748d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:40.523902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1912da4-dd45-4ba0-a40e-031f0b748d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:40.524180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1912da4-dd45-4ba0-a40e-031f0b748d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:40.524452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1912da4-dd45-4ba0-a40e-031f0b748d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:40.525142 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1912da4-dd45-4ba0-a40e-031f0b748d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:40.526757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1912da4-dd45-4ba0-a40e-031f0b748d05 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:40.537127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1038/2070] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:40.541069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150bff1-9fa1-4bc7-af46-194bf951931f admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:40.551101 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150bff1-9fa1-4bc7-af46-194bf951931f admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:40.556384 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03151b7-391b-4c1f-aaed-b7bf6849b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:40.556987 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03151b7-391b-4c1f-aaed-b7bf6849b12d admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:40.557267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03151b7-391b-4c1f-aaed-b7bf6849b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:40.557538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03151b7-391b-4c1f-aaed-b7bf6849b12d admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:40.558272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03151b7-391b-4c1f-aaed-b7bf6849b12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:40.559840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03151b7-391b-4c1f-aaed-b7bf6849b12d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:40.569654 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1033/2071] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:40.574155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1912da4-dd45-4ba0-a40e-031f0b748d05 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:40.584060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1912da4-dd45-4ba0-a40e-031f0b748d05 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:40.588690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3ae2c-603b-435f-9e76-3edaf7526918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:40.589340 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3ae2c-603b-435f-9e76-3edaf7526918 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:40.589621 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3ae2c-603b-435f-9e76-3edaf7526918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:40.589892 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3ae2c-603b-435f-9e76-3edaf7526918 admin admin] PATH_INFO: `/v3/projects/739539bc54134bec87cfd7bf58469d3b/users/1ea558d2b6ac4df7b3693167ae894e0a/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:40.605220 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3ae2c-603b-435f-9e76-3edaf7526918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=739539bc54134bec87cfd7bf58469d3b, user_id=1ea558d2b6ac4df7b3693167ae894e0a, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:40.607460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3ae2c-603b-435f-9e76-3edaf7526918 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:40.620224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1039/2072] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:40 2022] PUT /identity/v3/projects/739539bc54134bec87cfd7bf58469d3b/users/1ea558d2b6ac4df7b3693167ae894e0a/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:40.630647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed55084-6b74-4ad4-9c4c-6477155ee6e9 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:40.630934 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed55084-6b74-4ad4-9c4c-6477155ee6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:40.631210 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed55084-6b74-4ad4-9c4c-6477155ee6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:40.660470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-5ed55084-6b74-4ad4-9c4c-6477155ee6e9 None None] MFA Rules not processed for user `1ea558d2b6ac4df7b3693167ae894e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:40.662169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-5ed55084-6b74-4ad4-9c4c-6477155ee6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:40.728755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1034/2073] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:40.740603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3ae2c-603b-435f-9e76-3edaf7526918 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:40.742514 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5ca3ae2c-603b-435f-9e76-3edaf7526918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:40.813570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3ae2c-603b-435f-9e76-3edaf7526918 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:40.818398 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa7d54-54da-41ea-9ecd-69f02a63fd19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:40.819366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa7d54-54da-41ea-9ecd-69f02a63fd19 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:40.819836 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa7d54-54da-41ea-9ecd-69f02a63fd19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:40.820315 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa7d54-54da-41ea-9ecd-69f02a63fd19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:40.831839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa7d54-54da-41ea-9ecd-69f02a63fd19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:40.833941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa7d54-54da-41ea-9ecd-69f02a63fd19 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:40.850530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1040/2074] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:44.149722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed55084-6b74-4ad4-9c4c-6477155ee6e9 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:44.151183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-5ed55084-6b74-4ad4-9c4c-6477155ee6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:44.215885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed55084-6b74-4ad4-9c4c-6477155ee6e9 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:44.220488 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:44.221137 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:44.221420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:44.221695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] PATH_INFO: `/v3/users/33ec18d6dce74895894a11ab0f480cd4` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:44.222905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ec18d6dce74895894a11ab0f480cd4)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:44.224793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:44.273302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ec18d6dce74895894a11ab0f480cd4'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:44.273981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ec18d6dce74895894a11ab0f480cd4'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:44.276507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:44.281449 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ec18d6dce74895894a11ab0f480cd4'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:44.294607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ec18d6dce74895894a11ab0f480cd4'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:44.295246 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ec18d6dce74895894a11ab0f480cd4'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:44.308462 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1035/2075] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:44 2022] DELETE /identity/v3/users/33ec18d6dce74895894a11ab0f480cd4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:44.312908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f13ce-2a3e-4534-b9d7-9bde1536b5e2 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:44.313388 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f13ce-2a3e-4534-b9d7-9bde1536b5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:44.313504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f13ce-2a3e-4534-b9d7-9bde1536b5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:44.332880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-b81f13ce-2a3e-4534-b9d7-9bde1536b5e2 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:44.334138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b81f13ce-2a3e-4534-b9d7-9bde1536b5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:44.396813 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1041/2076] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:44.406498 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:44.408503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:44.467241 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d17a0-a4d6-40b0-8ccb-54be6a30c37d admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:44.470852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78160fe-0b38-48dc-bd99-59e95f2ed4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:44.471502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78160fe-0b38-48dc-bd99-59e95f2ed4ba service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:44.471783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78160fe-0b38-48dc-bd99-59e95f2ed4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:44.472060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78160fe-0b38-48dc-bd99-59e95f2ed4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:44.481780 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78160fe-0b38-48dc-bd99-59e95f2ed4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:44.483247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78160fe-0b38-48dc-bd99-59e95f2ed4ba service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:44.492689 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1036/2077] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:44.767097 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f13ce-2a3e-4534-b9d7-9bde1536b5e2 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:44.768543 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b81f13ce-2a3e-4534-b9d7-9bde1536b5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:44.781367 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f13ce-2a3e-4534-b9d7-9bde1536b5e2 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:44.785931 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:44.786627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:44.786908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:44.787183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] PATH_INFO: `/v3/projects/b91f0bf66d9f4fa7921be6fce4b9b93b` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:44.788430 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91f0bf66d9f4fa7921be6fce4b9b93b)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:44.791032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:44.842591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:44.853090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91f0bf66d9f4fa7921be6fce4b9b93b', 'request_id': 'req-83a6fc5b-7091-4961-99ad-ffbb24ab9949'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:44.859901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91f0bf66d9f4fa7921be6fce4b9b93b', 'request_id': 'req-83a6fc5b-7091-4961-99ad-ffbb24ab9949'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:44.865676 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91f0bf66d9f4fa7921be6fce4b9b93b', 'request_id': 'req-83a6fc5b-7091-4961-99ad-ffbb24ab9949'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:44.879077 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] The token cache is being invalidate because project b91f0bf66d9f4fa7921be6fce4b9b93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:44.879373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:44.880069 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:44.881668 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1042/2078] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:44 2022] DELETE /identity/v3/projects/b91f0bf66d9f4fa7921be6fce4b9b93b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:44.886882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78160fe-0b38-48dc-bd99-59e95f2ed4ba service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:44.904722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78160fe-0b38-48dc-bd99-59e95f2ed4ba service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:44.960003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6108e5-e921-4e4f-9405-723ff743148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:44.960698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6108e5-e921-4e4f-9405-723ff743148f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:44.961519 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6108e5-e921-4e4f-9405-723ff743148f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:44.961924 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6108e5-e921-4e4f-9405-723ff743148f admin admin] PATH_INFO: `/v3/users/28162e835dd94e29995e25f568327d87` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:44.963175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6108e5-e921-4e4f-9405-723ff743148f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28162e835dd94e29995e25f568327d87)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:44.965123 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6108e5-e921-4e4f-9405-723ff743148f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:45.011326 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-2e6108e5-e921-4e4f-9405-723ff743148f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28162e835dd94e29995e25f568327d87'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:45.011928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-2e6108e5-e921-4e4f-9405-723ff743148f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28162e835dd94e29995e25f568327d87'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:45.019435 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-2e6108e5-e921-4e4f-9405-723ff743148f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28162e835dd94e29995e25f568327d87'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:45.032147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-2e6108e5-e921-4e4f-9405-723ff743148f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28162e835dd94e29995e25f568327d87'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:45.032803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-2e6108e5-e921-4e4f-9405-723ff743148f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28162e835dd94e29995e25f568327d87'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:45.033958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:45.046899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1037/2079] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:44 2022] DELETE /identity/v3/users/28162e835dd94e29995e25f568327d87 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:45.340078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:45.341693 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:45.355440 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6fc5b-7091-4961-99ad-ffbb24ab9949 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:45.424781 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:45.425734 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:45.426218 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:45.426499 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] PATH_INFO: `/v3/projects/f29de4c1bb8b43af9bacf3117be88d04` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:45.427847 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29de4c1bb8b43af9bacf3117be88d04)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:45.430305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:45.478281 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29de4c1bb8b43af9bacf3117be88d04', 'request_id': 'req-747c7c4d-1562-472c-acc0-35c627dddb47'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:45.490920 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29de4c1bb8b43af9bacf3117be88d04', 'request_id': 'req-747c7c4d-1562-472c-acc0-35c627dddb47'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:45.497465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29de4c1bb8b43af9bacf3117be88d04', 'request_id': 'req-747c7c4d-1562-472c-acc0-35c627dddb47'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:45.510673 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] The token cache is being invalidate because project f29de4c1bb8b43af9bacf3117be88d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:45.510962 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:45.511616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-747c7c4d-1562-472c-acc0-35c627dddb47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:45.513162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1043/2080] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:45 2022] DELETE /identity/v3/projects/f29de4c1bb8b43af9bacf3117be88d04 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:45.519672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebdf0c-c8f9-4f38-a2c9-5c62664999a6 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:45.520526 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebdf0c-c8f9-4f38-a2c9-5c62664999a6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:45.520526 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebdf0c-c8f9-4f38-a2c9-5c62664999a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:45.540975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-caebdf0c-c8f9-4f38-a2c9-5c62664999a6 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:45.542331 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-caebdf0c-c8f9-4f38-a2c9-5c62664999a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:45.613505 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1038/2081] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:45.622306 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f010f96-d8c4-41f9-ac6a-40d2a83cf0f6 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:45.622658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f010f96-d8c4-41f9-ac6a-40d2a83cf0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:45.622943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f010f96-d8c4-41f9-ac6a-40d2a83cf0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:45.643912 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-1f010f96-d8c4-41f9-ac6a-40d2a83cf0f6 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:45.645141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1f010f96-d8c4-41f9-ac6a-40d2a83cf0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:45.656591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1044/2082] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:45.657804 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebdf0c-c8f9-4f38-a2c9-5c62664999a6 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:45.668532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebdf0c-c8f9-4f38-a2c9-5c62664999a6 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:45.673446 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba9c5e-9367-4e55-8d4c-edcebc1ed85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:45.674268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9c5e-9367-4e55-8d4c-edcebc1ed85a admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:45.674546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9c5e-9367-4e55-8d4c-edcebc1ed85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:45.674844 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9c5e-9367-4e55-8d4c-edcebc1ed85a admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:45.675597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba9c5e-9367-4e55-8d4c-edcebc1ed85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:45.675813 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba9c5e-9367-4e55-8d4c-edcebc1ed85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:45.677413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba9c5e-9367-4e55-8d4c-edcebc1ed85a admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:45.690874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1039/2083] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:45.695369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f010f96-d8c4-41f9-ac6a-40d2a83cf0f6 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:45.704716 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f010f96-d8c4-41f9-ac6a-40d2a83cf0f6 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:45.710853 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d056bc-a24e-48a5-aef4-146898d8f87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:45.711482 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d056bc-a24e-48a5-aef4-146898d8f87d admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:45.711765 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d056bc-a24e-48a5-aef4-146898d8f87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:45.712041 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d056bc-a24e-48a5-aef4-146898d8f87d admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:45.712719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d056bc-a24e-48a5-aef4-146898d8f87d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:45.714669 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d056bc-a24e-48a5-aef4-146898d8f87d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:45.744629 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1045/2084] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:45 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:45.748770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba9c5e-9367-4e55-8d4c-edcebc1ed85a admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:45.758783 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba9c5e-9367-4e55-8d4c-edcebc1ed85a admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:45.815794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb77ec-d427-437b-a593-700162ab2a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:45.816328 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb77ec-d427-437b-a593-700162ab2a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:45.816604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb77ec-d427-437b-a593-700162ab2a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:45.816876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb77ec-d427-437b-a593-700162ab2a61 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:45.817532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb77ec-d427-437b-a593-700162ab2a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:45.819449 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb77ec-d427-437b-a593-700162ab2a61 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:45.840082 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1040/2085] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:45 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:45.844224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d056bc-a24e-48a5-aef4-146898d8f87d admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:45.855085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d056bc-a24e-48a5-aef4-146898d8f87d admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:45.859754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8756aa7-b1ad-427e-9ebe-00e98e4e31bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:45.860359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8756aa7-b1ad-427e-9ebe-00e98e4e31bb admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:45.860661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8756aa7-b1ad-427e-9ebe-00e98e4e31bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:45.860919 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8756aa7-b1ad-427e-9ebe-00e98e4e31bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:45.861611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8756aa7-b1ad-427e-9ebe-00e98e4e31bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:45.863244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8756aa7-b1ad-427e-9ebe-00e98e4e31bb admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:45.873911 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1046/2086] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:45.877741 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb77ec-d427-437b-a593-700162ab2a61 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:45.889229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb77ec-d427-437b-a593-700162ab2a61 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:45.894402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf91d0-c18f-4b4e-bbcc-75e691d83230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:45.895038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf91d0-c18f-4b4e-bbcc-75e691d83230 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:45.895281 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf91d0-c18f-4b4e-bbcc-75e691d83230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:45.895552 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf91d0-c18f-4b4e-bbcc-75e691d83230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:45.896243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf91d0-c18f-4b4e-bbcc-75e691d83230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:45.897803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf91d0-c18f-4b4e-bbcc-75e691d83230 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:45.908571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1041/2087] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:45.912659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8756aa7-b1ad-427e-9ebe-00e98e4e31bb admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:45.923769 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8756aa7-b1ad-427e-9ebe-00e98e4e31bb admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:45.928508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e50f71-9640-4480-b9b2-ecfc01ad3559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:45.929378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50f71-9640-4480-b9b2-ecfc01ad3559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:45.930332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50f71-9640-4480-b9b2-ecfc01ad3559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:45.930614 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e50f71-9640-4480-b9b2-ecfc01ad3559 admin admin] PATH_INFO: `/v3/projects/3b8b1c44801348b6899178362aa60a78/users/069351bcf2e34389b022247c02f62d42/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:45.943407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:45.947266 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e50f71-9640-4480-b9b2-ecfc01ad3559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8b1c44801348b6899178362aa60a78, user_id=069351bcf2e34389b022247c02f62d42, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:45.950548 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e50f71-9640-4480-b9b2-ecfc01ad3559 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:45.967076 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1047/2088] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:45 2022] PUT /identity/v3/projects/3b8b1c44801348b6899178362aa60a78/users/069351bcf2e34389b022247c02f62d42/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:45.979027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111ea75-7f40-4d51-aa61-abffd68983c1 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:45.979317 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111ea75-7f40-4d51-aa61-abffd68983c1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:45.979595 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111ea75-7f40-4d51-aa61-abffd68983c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:46.007961 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-2111ea75-7f40-4d51-aa61-abffd68983c1 None None] MFA Rules not processed for user `069351bcf2e34389b022247c02f62d42`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:46.009178 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2111ea75-7f40-4d51-aa61-abffd68983c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:46.058291 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:46.081137 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1042/2089] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:46.086589 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e50f71-9640-4480-b9b2-ecfc01ad3559 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:46.148737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e50f71-9640-4480-b9b2-ecfc01ad3559 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:46.153371 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b291f3-c810-4dec-bf67-2f0e75a853bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:46.153983 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b291f3-c810-4dec-bf67-2f0e75a853bd admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:46.154288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b291f3-c810-4dec-bf67-2f0e75a853bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:46.154560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b291f3-c810-4dec-bf67-2f0e75a853bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:46.155224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b291f3-c810-4dec-bf67-2f0e75a853bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:46.157106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b291f3-c810-4dec-bf67-2f0e75a853bd admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:46.184139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1048/2090] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:46 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:46.188220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111ea75-7f40-4d51-aa61-abffd68983c1 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:46.199113 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111ea75-7f40-4d51-aa61-abffd68983c1 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:46.259234 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5e66d-3cf9-4eff-a30d-d49201664fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:46.259849 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5e66d-3cf9-4eff-a30d-d49201664fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:46.260135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5e66d-3cf9-4eff-a30d-d49201664fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:46.260411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5e66d-3cf9-4eff-a30d-d49201664fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:46.261079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5e66d-3cf9-4eff-a30d-d49201664fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:46.263111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5e66d-3cf9-4eff-a30d-d49201664fe2 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:46.287300 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1043/2091] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:46 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:46.291882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b291f3-c810-4dec-bf67-2f0e75a853bd admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:46.303019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b291f3-c810-4dec-bf67-2f0e75a853bd admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:46.307856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e75b2f-f848-47a4-b429-1aa130ea776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:46.308884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e75b2f-f848-47a4-b429-1aa130ea776f admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:46.309170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e75b2f-f848-47a4-b429-1aa130ea776f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:46.309445 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e75b2f-f848-47a4-b429-1aa130ea776f admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:46.310221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e75b2f-f848-47a4-b429-1aa130ea776f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:46.312184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e75b2f-f848-47a4-b429-1aa130ea776f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:46.324099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1049/2092] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:46.328835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5e66d-3cf9-4eff-a30d-d49201664fe2 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:46.340162 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5e66d-3cf9-4eff-a30d-d49201664fe2 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:46.344921 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170dabc-4d07-4951-916c-418c19eff04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:46.345697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170dabc-4d07-4951-916c-418c19eff04a admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:46.345979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170dabc-4d07-4951-916c-418c19eff04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:46.346309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170dabc-4d07-4951-916c-418c19eff04a admin admin] PATH_INFO: `/v3/projects/58125184283d4a9b87fee1480ab77816/users/bdd1b3e82c0b408b97946b98f6839ad7/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:46.371559 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170dabc-4d07-4951-916c-418c19eff04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58125184283d4a9b87fee1480ab77816, user_id=bdd1b3e82c0b408b97946b98f6839ad7, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:46.374407 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170dabc-4d07-4951-916c-418c19eff04a admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:46.387569 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1044/2093] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:46 2022] PUT /identity/v3/projects/58125184283d4a9b87fee1480ab77816/users/bdd1b3e82c0b408b97946b98f6839ad7/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:46.391798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e75b2f-f848-47a4-b429-1aa130ea776f admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:46.402137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e75b2f-f848-47a4-b429-1aa130ea776f admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:46.461793 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c72a30-5bd7-4550-b15d-4a678bf01f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:46.462443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72a30-5bd7-4550-b15d-4a678bf01f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:46.463024 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72a30-5bd7-4550-b15d-4a678bf01f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:46.463209 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c72a30-5bd7-4550-b15d-4a678bf01f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:46.463910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c72a30-5bd7-4550-b15d-4a678bf01f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:46.465737 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c72a30-5bd7-4550-b15d-4a678bf01f96 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:46.478446 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1050/2094] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:46.482744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170dabc-4d07-4951-916c-418c19eff04a admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:46.495147 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170dabc-4d07-4951-916c-418c19eff04a admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:46.501160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe03b2-133c-4c7b-ac4d-477d4f5ba9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:46.501870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe03b2-133c-4c7b-ac4d-477d4f5ba9c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:46.502603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe03b2-133c-4c7b-ac4d-477d4f5ba9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:46.502902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe03b2-133c-4c7b-ac4d-477d4f5ba9c2 admin admin] PATH_INFO: `/v3/projects/58125184283d4a9b87fee1480ab77816/users/bdd1b3e82c0b408b97946b98f6839ad7/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:46.505031 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe03b2-133c-4c7b-ac4d-477d4f5ba9c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58125184283d4a9b87fee1480ab77816, user_id=bdd1b3e82c0b408b97946b98f6839ad7, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:46.507760 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe03b2-133c-4c7b-ac4d-477d4f5ba9c2 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:46.519739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1045/2095] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:46 2022] PUT /identity/v3/projects/58125184283d4a9b87fee1480ab77816/users/bdd1b3e82c0b408b97946b98f6839ad7/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:46.530802 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f7cf-8d4b-4278-82b8-f58a2fbb845c None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:46.531364 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f7cf-8d4b-4278-82b8-f58a2fbb845c None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:46.531652 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5f7cf-8d4b-4278-82b8-f58a2fbb845c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:46.561814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-c4a5f7cf-8d4b-4278-82b8-f58a2fbb845c None None] MFA Rules not processed for user `bdd1b3e82c0b408b97946b98f6839ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:46.563076 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c4a5f7cf-8d4b-4278-82b8-f58a2fbb845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:46.612533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:46.639435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1051/2096] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:46.651680 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe03b2-133c-4c7b-ac4d-477d4f5ba9c2 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:46.654604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-bdbe03b2-133c-4c7b-ac4d-477d4f5ba9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:46.733616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe03b2-133c-4c7b-ac4d-477d4f5ba9c2 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:46.737253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bb6c6-284e-4aaf-a4c4-e54cc3ed13f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:46.737874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bb6c6-284e-4aaf-a4c4-e54cc3ed13f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:46.738210 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bb6c6-284e-4aaf-a4c4-e54cc3ed13f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:46.738497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bb6c6-284e-4aaf-a4c4-e54cc3ed13f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:46.748004 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bb6c6-284e-4aaf-a4c4-e54cc3ed13f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:46.749462 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bb6c6-284e-4aaf-a4c4-e54cc3ed13f3 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:46.759594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1046/2097] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:47.225958 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5f7cf-8d4b-4278-82b8-f58a2fbb845c None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:47.292474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5f7cf-8d4b-4278-82b8-f58a2fbb845c None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:47.299063 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:47.299709 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:47.299991 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:47.300270 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] PATH_INFO: `/v3/users/069351bcf2e34389b022247c02f62d42` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:47.301504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=069351bcf2e34389b022247c02f62d42)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:47.303477 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:47.352205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069351bcf2e34389b022247c02f62d42'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:47.361756 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069351bcf2e34389b022247c02f62d42'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:47.370214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069351bcf2e34389b022247c02f62d42'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:47.370805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069351bcf2e34389b022247c02f62d42'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:47.384458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069351bcf2e34389b022247c02f62d42'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:47.391414 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1052/2098] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:47 2022] DELETE /identity/v3/users/069351bcf2e34389b022247c02f62d42 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:47.396040 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd464-a3e8-4a38-b74b-3da2f628e89c None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:47.396329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd464-a3e8-4a38-b74b-3da2f628e89c None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:47.396614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fd464-a3e8-4a38-b74b-3da2f628e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:47.419019 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-8b1fd464-a3e8-4a38-b74b-3da2f628e89c None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:47.420357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8b1fd464-a3e8-4a38-b74b-3da2f628e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:47.453758 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:47.482591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1047/2099] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:47.493060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:47.494533 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:47.551744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489b97b-07da-4200-b1e7-e87579816f65 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:47.555944 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf46f-d700-4053-a46b-192df7f9117e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:47.556557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf46f-d700-4053-a46b-192df7f9117e service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:47.556842 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf46f-d700-4053-a46b-192df7f9117e service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:47.557125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cf46f-d700-4053-a46b-192df7f9117e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:47.566208 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cf46f-d700-4053-a46b-192df7f9117e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:47.567633 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cf46f-d700-4053-a46b-192df7f9117e service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:47.577666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1053/2100] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:48.074591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd464-a3e8-4a38-b74b-3da2f628e89c None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:48.076117 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8b1fd464-a3e8-4a38-b74b-3da2f628e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:48.089393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fd464-a3e8-4a38-b74b-3da2f628e89c None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:48.097350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:48.097986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:48.098311 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:48.098592 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] PATH_INFO: `/v3/projects/3b8b1c44801348b6899178362aa60a78` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:48.099760 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8b1c44801348b6899178362aa60a78)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:48.103546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:48.155662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8b1c44801348b6899178362aa60a78', 'request_id': 'req-9b8c4496-0997-4d6c-ae0f-40cab855bef9'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:48.162061 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8b1c44801348b6899178362aa60a78', 'request_id': 'req-9b8c4496-0997-4d6c-ae0f-40cab855bef9'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:48.167934 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8b1c44801348b6899178362aa60a78', 'request_id': 'req-9b8c4496-0997-4d6c-ae0f-40cab855bef9'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:48.180906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] The token cache is being invalidate because project 3b8b1c44801348b6899178362aa60a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:48.181111 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:48.181794 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:48.183775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1048/2101] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:48 2022] DELETE /identity/v3/projects/3b8b1c44801348b6899178362aa60a78 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:48.187734 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf46f-d700-4053-a46b-192df7f9117e service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:48.199648 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cf46f-d700-4053-a46b-192df7f9117e service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:48.205050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:48.273244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb132c8-98ce-4774-8326-cbd32379e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:48.275771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb132c8-98ce-4774-8326-cbd32379e1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:48.276344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb132c8-98ce-4774-8326-cbd32379e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:48.276834 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb132c8-98ce-4774-8326-cbd32379e1e5 admin admin] PATH_INFO: `/v3/users/bdd1b3e82c0b408b97946b98f6839ad7` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:48.278946 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb132c8-98ce-4774-8326-cbd32379e1e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd1b3e82c0b408b97946b98f6839ad7)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:48.282741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb132c8-98ce-4774-8326-cbd32379e1e5 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:48.406180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-beb132c8-98ce-4774-8326-cbd32379e1e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd1b3e82c0b408b97946b98f6839ad7'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:48.418229 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-beb132c8-98ce-4774-8326-cbd32379e1e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd1b3e82c0b408b97946b98f6839ad7'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:48.428022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-beb132c8-98ce-4774-8326-cbd32379e1e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd1b3e82c0b408b97946b98f6839ad7'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:48.428993 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-beb132c8-98ce-4774-8326-cbd32379e1e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd1b3e82c0b408b97946b98f6839ad7'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:48.446677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-beb132c8-98ce-4774-8326-cbd32379e1e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd1b3e82c0b408b97946b98f6839ad7'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:48.453746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1054/2102] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:48 2022] DELETE /identity/v3/users/bdd1b3e82c0b408b97946b98f6839ad7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:48.870518 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:48.872594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:48.907744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c4496-0997-4d6c-ae0f-40cab855bef9 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:48.977139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:48.977788 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:48.978096 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:48.978388 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] PATH_INFO: `/v3/projects/58125184283d4a9b87fee1480ab77816` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:48.979669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58125184283d4a9b87fee1480ab77816)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:48.981565 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:49.028214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58125184283d4a9b87fee1480ab77816', 'request_id': 'req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:49.034437 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58125184283d4a9b87fee1480ab77816', 'request_id': 'req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:49.039968 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58125184283d4a9b87fee1480ab77816', 'request_id': 'req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:49.042567 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:49.059905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] The token cache is being invalidate because project 58125184283d4a9b87fee1480ab77816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:49.060237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:49.061778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-81630de2-b9ff-4279-9919-c0e3d9e2a4e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:49.064416 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1049/2103] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:48 2022] DELETE /identity/v3/projects/58125184283d4a9b87fee1480ab77816 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:49.070410 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c45e4-ba68-4824-a3eb-3e1a05cef316 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:49.070885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c45e4-ba68-4824-a3eb-3e1a05cef316 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:49.070994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c45e4-ba68-4824-a3eb-3e1a05cef316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:49.093978 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-fa1c45e4-ba68-4824-a3eb-3e1a05cef316 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:49.095283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fa1c45e4-ba68-4824-a3eb-3e1a05cef316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:49.177251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1055/2104] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:49.186196 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf082ea-da62-4714-983a-36692b1af604 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:49.187094 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf082ea-da62-4714-983a-36692b1af604 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:49.187384 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf082ea-da62-4714-983a-36692b1af604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:49.221030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6bf082ea-da62-4714-983a-36692b1af604 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:49.222582 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6bf082ea-da62-4714-983a-36692b1af604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:49.231387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1050/2105] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:49.245728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c45e4-ba68-4824-a3eb-3e1a05cef316 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:49.255927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c45e4-ba68-4824-a3eb-3e1a05cef316 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:49.261456 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6951a-e0c7-4403-8a01-f5ec29a69de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:49.262091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6951a-e0c7-4403-8a01-f5ec29a69de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:49.262378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6951a-e0c7-4403-8a01-f5ec29a69de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:49.262626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6951a-e0c7-4403-8a01-f5ec29a69de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:49.263326 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6951a-e0c7-4403-8a01-f5ec29a69de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:49.263634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6951a-e0c7-4403-8a01-f5ec29a69de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:49.270720 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6951a-e0c7-4403-8a01-f5ec29a69de9 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:49.283763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1056/2106] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:49.287850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf082ea-da62-4714-983a-36692b1af604 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:49.297979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf082ea-da62-4714-983a-36692b1af604 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:49.303246 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cc90b-f809-46c3-857b-4ef5ebd066cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:49.304623 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc90b-f809-46c3-857b-4ef5ebd066cd admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:49.305093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc90b-f809-46c3-857b-4ef5ebd066cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:49.305367 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc90b-f809-46c3-857b-4ef5ebd066cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:49.306078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cc90b-f809-46c3-857b-4ef5ebd066cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:49.308160 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cc90b-f809-46c3-857b-4ef5ebd066cd admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:49.345719 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1051/2107] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:49 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:49.360627 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6951a-e0c7-4403-8a01-f5ec29a69de9 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:49.376728 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6951a-e0c7-4403-8a01-f5ec29a69de9 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:49.391337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:49.444595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c2e32-c5b6-431e-967d-50afe05ca9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:49.444595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c2e32-c5b6-431e-967d-50afe05ca9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:49.444595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c2e32-c5b6-431e-967d-50afe05ca9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:49.444595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c2e32-c5b6-431e-967d-50afe05ca9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:49.444980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c2e32-c5b6-431e-967d-50afe05ca9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:49.444980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c2e32-c5b6-431e-967d-50afe05ca9d9 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:49.473144 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1057/2108] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:49 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:49.474533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cc90b-f809-46c3-857b-4ef5ebd066cd admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:49.485953 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cc90b-f809-46c3-857b-4ef5ebd066cd admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:49.490671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542fc83-df95-4268-9f84-b6d6b587495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:49.491283 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542fc83-df95-4268-9f84-b6d6b587495a admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:49.491582 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542fc83-df95-4268-9f84-b6d6b587495a admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:49.492373 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542fc83-df95-4268-9f84-b6d6b587495a admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:49.493067 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542fc83-df95-4268-9f84-b6d6b587495a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:49.494728 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542fc83-df95-4268-9f84-b6d6b587495a admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:49.506243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1052/2109] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:49.510788 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c2e32-c5b6-431e-967d-50afe05ca9d9 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:49.521288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c2e32-c5b6-431e-967d-50afe05ca9d9 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:49.526827 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc373d2-89aa-48f3-9f58-e575f198c7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:49.527507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc373d2-89aa-48f3-9f58-e575f198c7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:49.527945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc373d2-89aa-48f3-9f58-e575f198c7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:49.528247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc373d2-89aa-48f3-9f58-e575f198c7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:49.528947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc373d2-89aa-48f3-9f58-e575f198c7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:49.530620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc373d2-89aa-48f3-9f58-e575f198c7fc admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:49.541978 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1058/2110] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:49.545822 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542fc83-df95-4268-9f84-b6d6b587495a admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:49.555945 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542fc83-df95-4268-9f84-b6d6b587495a admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:49.560702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7680b1-35f9-4a54-af39-722d6d82e48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:49.561369 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7680b1-35f9-4a54-af39-722d6d82e48c admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:49.561645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7680b1-35f9-4a54-af39-722d6d82e48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:49.561920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7680b1-35f9-4a54-af39-722d6d82e48c admin admin] PATH_INFO: `/v3/projects/e8bb56174fec40aba8e665edcd9eebc6/users/4966e7d35d8b46268821c3c079859d60/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:49.577517 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7680b1-35f9-4a54-af39-722d6d82e48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bb56174fec40aba8e665edcd9eebc6, user_id=4966e7d35d8b46268821c3c079859d60, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:49.580169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7680b1-35f9-4a54-af39-722d6d82e48c admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:49.593989 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1053/2111] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:49 2022] PUT /identity/v3/projects/e8bb56174fec40aba8e665edcd9eebc6/users/4966e7d35d8b46268821c3c079859d60/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:49.607715 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ec8d2-b3b2-40d5-8f34-8fe587e1571b None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:49.608089 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ec8d2-b3b2-40d5-8f34-8fe587e1571b None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:49.608448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ec8d2-b3b2-40d5-8f34-8fe587e1571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:49.641242 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-ba1ec8d2-b3b2-40d5-8f34-8fe587e1571b None None] MFA Rules not processed for user `4966e7d35d8b46268821c3c079859d60`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:49.643003 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ba1ec8d2-b3b2-40d5-8f34-8fe587e1571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:49.744323 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1059/2112] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:49.749229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7680b1-35f9-4a54-af39-722d6d82e48c admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:49.921281 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7680b1-35f9-4a54-af39-722d6d82e48c admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:49.937106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c618aab-b96c-4109-ad07-ce11fefb0f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:49.937756 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c618aab-b96c-4109-ad07-ce11fefb0f53 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:49.938065 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c618aab-b96c-4109-ad07-ce11fefb0f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:49.938357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c618aab-b96c-4109-ad07-ce11fefb0f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:49.939043 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c618aab-b96c-4109-ad07-ce11fefb0f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:49.944285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c618aab-b96c-4109-ad07-ce11fefb0f53 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:49.981839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1054/2113] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:49 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:49.985855 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ec8d2-b3b2-40d5-8f34-8fe587e1571b None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:49.997079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ec8d2-b3b2-40d5-8f34-8fe587e1571b None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:50.064460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728de815-ffbe-4f2c-912e-2e3e85eaf6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:50.065090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728de815-ffbe-4f2c-912e-2e3e85eaf6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.065362 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728de815-ffbe-4f2c-912e-2e3e85eaf6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.065635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728de815-ffbe-4f2c-912e-2e3e85eaf6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.066777 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728de815-ffbe-4f2c-912e-2e3e85eaf6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:50.068281 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728de815-ffbe-4f2c-912e-2e3e85eaf6c5 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:50.090457 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1060/2114] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:49 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:50.094631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c618aab-b96c-4109-ad07-ce11fefb0f53 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:50.105832 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c618aab-b96c-4109-ad07-ce11fefb0f53 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:50.110624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba299e-a5b2-419c-8528-5d206181392f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:50.111309 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba299e-a5b2-419c-8528-5d206181392f admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.111593 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba299e-a5b2-419c-8528-5d206181392f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.111881 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba299e-a5b2-419c-8528-5d206181392f admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.112660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba299e-a5b2-419c-8528-5d206181392f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:50.114282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba299e-a5b2-419c-8528-5d206181392f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:50.125518 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1055/2115] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:50.130747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728de815-ffbe-4f2c-912e-2e3e85eaf6c5 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:50.143671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728de815-ffbe-4f2c-912e-2e3e85eaf6c5 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:50.150055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861fde7-937f-4777-b067-99f1f312f2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:50.150694 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861fde7-937f-4777-b067-99f1f312f2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.150975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861fde7-937f-4777-b067-99f1f312f2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.151248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861fde7-937f-4777-b067-99f1f312f2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.152005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861fde7-937f-4777-b067-99f1f312f2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:50.153618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861fde7-937f-4777-b067-99f1f312f2d6 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:50.165098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1061/2116] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:50.169536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba299e-a5b2-419c-8528-5d206181392f admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:50.180447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba299e-a5b2-419c-8528-5d206181392f admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:50.185171 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31446d96-9940-4aa3-8427-d35dd8c049e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:50.185863 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31446d96-9940-4aa3-8427-d35dd8c049e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.186164 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31446d96-9940-4aa3-8427-d35dd8c049e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.186440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31446d96-9940-4aa3-8427-d35dd8c049e3 admin admin] PATH_INFO: `/v3/projects/b5f8eaab304e464a840f112c51d7d47d/users/fe2580e3ec7f4352898da6a7249d3341/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.202888 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31446d96-9940-4aa3-8427-d35dd8c049e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f8eaab304e464a840f112c51d7d47d, user_id=fe2580e3ec7f4352898da6a7249d3341, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:50.205715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31446d96-9940-4aa3-8427-d35dd8c049e3 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:50.238413 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1056/2117] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:50 2022] PUT /identity/v3/projects/b5f8eaab304e464a840f112c51d7d47d/users/fe2580e3ec7f4352898da6a7249d3341/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:50.240646 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd935be-e98e-4a0c-9453-1baebe317254 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.240973 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd935be-e98e-4a0c-9453-1baebe317254 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.241291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd935be-e98e-4a0c-9453-1baebe317254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.249354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:50.287759 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-1cd935be-e98e-4a0c-9453-1baebe317254 None None] MFA Rules not processed for user `fe2580e3ec7f4352898da6a7249d3341`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:50.289153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1cd935be-e98e-4a0c-9453-1baebe317254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:50.380197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1062/2118] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:50.381325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31446d96-9940-4aa3-8427-d35dd8c049e3 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:50.467751 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:50.490645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31446d96-9940-4aa3-8427-d35dd8c049e3 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:50.495561 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493df087-3830-47c3-af35-3422e0d31336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:50.496274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493df087-3830-47c3-af35-3422e0d31336 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.496630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493df087-3830-47c3-af35-3422e0d31336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.497284 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493df087-3830-47c3-af35-3422e0d31336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.498303 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493df087-3830-47c3-af35-3422e0d31336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:50.500342 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493df087-3830-47c3-af35-3422e0d31336 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:50.533055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1057/2119] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:50 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:50.537338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd935be-e98e-4a0c-9453-1baebe317254 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:50.550859 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd935be-e98e-4a0c-9453-1baebe317254 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:50.636392 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfb71e-f5c8-4991-bd06-f4092eab2912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:50.637133 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfb71e-f5c8-4991-bd06-f4092eab2912 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.637618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfb71e-f5c8-4991-bd06-f4092eab2912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.637902 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfb71e-f5c8-4991-bd06-f4092eab2912 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.640002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfb71e-f5c8-4991-bd06-f4092eab2912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:50.642412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfb71e-f5c8-4991-bd06-f4092eab2912 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:50.674462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1063/2120] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:50 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:50.678561 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493df087-3830-47c3-af35-3422e0d31336 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:50.688808 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493df087-3830-47c3-af35-3422e0d31336 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:50.693491 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f807ad7-53ac-493d-a763-7e679020119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:50.694140 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807ad7-53ac-493d-a763-7e679020119c admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.694428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807ad7-53ac-493d-a763-7e679020119c admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.694734 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807ad7-53ac-493d-a763-7e679020119c admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.695452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f807ad7-53ac-493d-a763-7e679020119c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:50.697036 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f807ad7-53ac-493d-a763-7e679020119c admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:50.712166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1058/2121] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:50.713736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfb71e-f5c8-4991-bd06-f4092eab2912 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:50.724766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfb71e-f5c8-4991-bd06-f4092eab2912 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:50.730236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1bc36-d73d-4805-b28b-135fce19cad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:50.730895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1bc36-d73d-4805-b28b-135fce19cad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.731271 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1bc36-d73d-4805-b28b-135fce19cad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.731547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1bc36-d73d-4805-b28b-135fce19cad7 admin admin] PATH_INFO: `/v3/projects/e534aa662250413795ed218e776292c0/users/12c1bb35fbc64253bce629f613febbf0/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.747637 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1bc36-d73d-4805-b28b-135fce19cad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e534aa662250413795ed218e776292c0, user_id=12c1bb35fbc64253bce629f613febbf0, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:50.750301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1bc36-d73d-4805-b28b-135fce19cad7 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:50.763347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1064/2122] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:50 2022] PUT /identity/v3/projects/e534aa662250413795ed218e776292c0/users/12c1bb35fbc64253bce629f613febbf0/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:50.767784 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f807ad7-53ac-493d-a763-7e679020119c admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:50.778664 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f807ad7-53ac-493d-a763-7e679020119c admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:50.839868 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f8b94-8716-4e75-af15-3b51db36cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:50.840503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f8b94-8716-4e75-af15-3b51db36cd97 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.840784 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f8b94-8716-4e75-af15-3b51db36cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.841056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f8b94-8716-4e75-af15-3b51db36cd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.841761 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f8b94-8716-4e75-af15-3b51db36cd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:50.843354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f8b94-8716-4e75-af15-3b51db36cd97 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:50.856363 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1059/2123] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:50.857874 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1bc36-d73d-4805-b28b-135fce19cad7 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:50.870363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1bc36-d73d-4805-b28b-135fce19cad7 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:50.877744 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd164c1d-c06c-4752-af18-f762ac0277aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:50.878959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164c1d-c06c-4752-af18-f762ac0277aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.879399 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164c1d-c06c-4752-af18-f762ac0277aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.879832 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164c1d-c06c-4752-af18-f762ac0277aa admin admin] PATH_INFO: `/v3/projects/e534aa662250413795ed218e776292c0/users/12c1bb35fbc64253bce629f613febbf0/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.884546 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd164c1d-c06c-4752-af18-f762ac0277aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e534aa662250413795ed218e776292c0, user_id=12c1bb35fbc64253bce629f613febbf0, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:50.887268 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd164c1d-c06c-4752-af18-f762ac0277aa admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:50.903754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1065/2124] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:50 2022] PUT /identity/v3/projects/e534aa662250413795ed218e776292c0/users/12c1bb35fbc64253bce629f613febbf0/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:50.915519 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d05cc3-4d07-44c2-ac01-1e825cafc2be None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:50.915744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d05cc3-4d07-44c2-ac01-1e825cafc2be None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:50.916165 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d05cc3-4d07-44c2-ac01-1e825cafc2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:50.951812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-09d05cc3-4d07-44c2-ac01-1e825cafc2be None None] MFA Rules not processed for user `12c1bb35fbc64253bce629f613febbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:50.953325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-09d05cc3-4d07-44c2-ac01-1e825cafc2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:51.005022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd164c1d-c06c-4752-af18-f762ac0277aa admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:51.006745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-dd164c1d-c06c-4752-af18-f762ac0277aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:51.047685 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1060/2125] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:51.091525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d05cc3-4d07-44c2-ac01-1e825cafc2be None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:51.093620 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-09d05cc3-4d07-44c2-ac01-1e825cafc2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:51.102504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:51.142766 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd164c1d-c06c-4752-af18-f762ac0277aa admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:51.147976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:51.148630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:51.148913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:51.149191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] PATH_INFO: `/v3/users/1ea558d2b6ac4df7b3693167ae894e0a` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:51.150538 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea558d2b6ac4df7b3693167ae894e0a)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:51.152515 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:51.180554 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:51.204145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d05cc3-4d07-44c2-ac01-1e825cafc2be None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:51.208144 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0364a9-d2d8-47c2-83a0-6095e34ef99b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:51.208765 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0364a9-d2d8-47c2-83a0-6095e34ef99b service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:51.209043 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0364a9-d2d8-47c2-83a0-6095e34ef99b service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:51.209354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0364a9-d2d8-47c2-83a0-6095e34ef99b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:51.214523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea558d2b6ac4df7b3693167ae894e0a'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:51.221200 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0364a9-d2d8-47c2-83a0-6095e34ef99b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:51.221778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea558d2b6ac4df7b3693167ae894e0a'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:51.222796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0364a9-d2d8-47c2-83a0-6095e34ef99b service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:51.230873 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea558d2b6ac4df7b3693167ae894e0a'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:51.231586 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea558d2b6ac4df7b3693167ae894e0a'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:51.237800 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1061/2126] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:51.245896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea558d2b6ac4df7b3693167ae894e0a'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:51.254065 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1066/2127] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:51 2022] DELETE /identity/v3/users/1ea558d2b6ac4df7b3693167ae894e0a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:51.256739 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a70e8-2ee6-4bae-bb87-8b835de5a77a None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:51.257037 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a70e8-2ee6-4bae-bb87-8b835de5a77a None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:51.257909 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a70e8-2ee6-4bae-bb87-8b835de5a77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:51.282673 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-bc6a70e8-2ee6-4bae-bb87-8b835de5a77a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:51.284044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-bc6a70e8-2ee6-4bae-bb87-8b835de5a77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:51.290252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:51.292273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:51.352474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1062/2128] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:51.368273 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a70e8-2ee6-4bae-bb87-8b835de5a77a None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:51.369733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-bc6a70e8-2ee6-4bae-bb87-8b835de5a77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:51.378048 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa06bb-e832-4d6a-a8b9-3ff3326604ca admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:51.381772 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4153f-b803-40b9-b5a3-01095e4fc27e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:51.382568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4153f-b803-40b9-b5a3-01095e4fc27e service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:51.382943 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4153f-b803-40b9-b5a3-01095e4fc27e service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:51.383340 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4153f-b803-40b9-b5a3-01095e4fc27e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:51.385244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-58d4153f-b803-40b9-b5a3-01095e4fc27e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:51.436531 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a70e8-2ee6-4bae-bb87-8b835de5a77a None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:51.441340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b296f9e-7acc-4f61-95e6-f856d739e405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:51.441978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296f9e-7acc-4f61-95e6-f856d739e405 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:51.442613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296f9e-7acc-4f61-95e6-f856d739e405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:51.442904 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b296f9e-7acc-4f61-95e6-f856d739e405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:51.457293 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4153f-b803-40b9-b5a3-01095e4fc27e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:51.457533 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b296f9e-7acc-4f61-95e6-f856d739e405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:51.459128 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b296f9e-7acc-4f61-95e6-f856d739e405 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:51.459261 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4153f-b803-40b9-b5a3-01095e4fc27e service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:51.471262 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1067/2129] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:51.472337 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1063/2130] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:51.956085 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4153f-b803-40b9-b5a3-01095e4fc27e service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:51.957512 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-58d4153f-b803-40b9-b5a3-01095e4fc27e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:51.993253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4153f-b803-40b9-b5a3-01095e4fc27e service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:51.999214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:51.999872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:52.000121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:52.000606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] PATH_INFO: `/v3/projects/739539bc54134bec87cfd7bf58469d3b` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:52.002644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=739539bc54134bec87cfd7bf58469d3b)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:52.004596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:52.019644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:52.066746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739539bc54134bec87cfd7bf58469d3b', 'request_id': 'req-bc26e580-bfb5-4afe-8874-e503f50e0f32'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:52.074486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739539bc54134bec87cfd7bf58469d3b', 'request_id': 'req-bc26e580-bfb5-4afe-8874-e503f50e0f32'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:52.080434 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739539bc54134bec87cfd7bf58469d3b', 'request_id': 'req-bc26e580-bfb5-4afe-8874-e503f50e0f32'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:52.098314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] The token cache is being invalidate because project 739539bc54134bec87cfd7bf58469d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:52.098314 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:52.098946 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-bc26e580-bfb5-4afe-8874-e503f50e0f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:52.100778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1068/2131] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:51 2022] DELETE /identity/v3/projects/739539bc54134bec87cfd7bf58469d3b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:54.534418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b296f9e-7acc-4f61-95e6-f856d739e405 service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:54.535895 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2b296f9e-7acc-4f61-95e6-f856d739e405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:54.548958 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b296f9e-7acc-4f61-95e6-f856d739e405 service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:54.609959 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:54.610640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:54.610932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:54.611214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] PATH_INFO: `/v3/users/4966e7d35d8b46268821c3c079859d60` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:54.612415 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4966e7d35d8b46268821c3c079859d60)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:54.614420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:54.640639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:54.666549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4966e7d35d8b46268821c3c079859d60'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:54.667337 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4966e7d35d8b46268821c3c079859d60'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:54.677664 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4966e7d35d8b46268821c3c079859d60'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:54.695143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4966e7d35d8b46268821c3c079859d60'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:54.696030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4966e7d35d8b46268821c3c079859d60'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:54.711924 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1064/2132] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:54 2022] DELETE /identity/v3/users/4966e7d35d8b46268821c3c079859d60 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:54.716135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2deb-dd57-4cd9-92fe-75c08e19f985 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:54.716663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2deb-dd57-4cd9-92fe-75c08e19f985 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:54.716760 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2deb-dd57-4cd9-92fe-75c08e19f985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:54.738692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-65fa2deb-dd57-4cd9-92fe-75c08e19f985 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:54.739921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-65fa2deb-dd57-4cd9-92fe-75c08e19f985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:54.815615 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1069/2133] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:54.825754 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:54.827226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:54.877881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa2deb-dd57-4cd9-92fe-75c08e19f985 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:54.879610 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-65fa2deb-dd57-4cd9-92fe-75c08e19f985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:54.890487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80c614-901e-4dc2-842f-0ba3ce36d00c admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:54.891840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa2deb-dd57-4cd9-92fe-75c08e19f985 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:54.894972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4681c-9806-4ecc-8317-10e6e6029e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:54.895592 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4681c-9806-4ecc-8317-10e6e6029e10 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:54.896004 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4681c-9806-4ecc-8317-10e6e6029e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:54.896288 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4681c-9806-4ecc-8317-10e6e6029e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:54.897583 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:54.898249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:54.898676 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:54.899098 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] PATH_INFO: `/v3/users/8edfeed052314bbfa75bc96204de6632` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:54.900415 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edfeed052314bbfa75bc96204de6632)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:54.902496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:54.910066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4681c-9806-4ecc-8317-10e6e6029e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:54.911658 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4681c-9806-4ecc-8317-10e6e6029e10 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:54.926493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1065/2134] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:54.964050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edfeed052314bbfa75bc96204de6632'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:54.972515 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edfeed052314bbfa75bc96204de6632'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:54.983379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edfeed052314bbfa75bc96204de6632'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:54.984114 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edfeed052314bbfa75bc96204de6632'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:54.998333 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edfeed052314bbfa75bc96204de6632'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.005244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1070/2135] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:54 2022] DELETE /identity/v3/users/8edfeed052314bbfa75bc96204de6632 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:55.010761 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97dbe5-3d9f-4bc7-a421-dfe8c266fded None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:55.011093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97dbe5-3d9f-4bc7-a421-dfe8c266fded None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:55.011371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97dbe5-3d9f-4bc7-a421-dfe8c266fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:55.032700 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-8c97dbe5-3d9f-4bc7-a421-dfe8c266fded None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:55.033847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8c97dbe5-3d9f-4bc7-a421-dfe8c266fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:55.103148 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1066/2136] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:55.114358 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:55.115784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:55.136279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:55.197516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c499bb-0284-4575-a4fa-a14385765914 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:55.201640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fe4ac-2938-4cca-ab5d-143916056a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:55.202413 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fe4ac-2938-4cca-ab5d-143916056a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:55.202791 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fe4ac-2938-4cca-ab5d-143916056a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:55.203064 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fe4ac-2938-4cca-ab5d-143916056a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:55.212741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fe4ac-2938-4cca-ab5d-143916056a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:55.214204 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fe4ac-2938-4cca-ab5d-143916056a69 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:55.224407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1071/2137] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:24:55.353578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97dbe5-3d9f-4bc7-a421-dfe8c266fded None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:55.355374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-8c97dbe5-3d9f-4bc7-a421-dfe8c266fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:55.380297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97dbe5-3d9f-4bc7-a421-dfe8c266fded None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:55.396746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:55.396746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:55.396746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:55.396746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] PATH_INFO: `/v3/projects/e8bb56174fec40aba8e665edcd9eebc6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:55.397181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8bb56174fec40aba8e665edcd9eebc6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:55.398532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:55.461906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:55.472536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bb56174fec40aba8e665edcd9eebc6', 'request_id': 'req-6b494ea6-7289-4353-b4ea-179a637ad085'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.481932 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bb56174fec40aba8e665edcd9eebc6', 'request_id': 'req-6b494ea6-7289-4353-b4ea-179a637ad085'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.490920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bb56174fec40aba8e665edcd9eebc6', 'request_id': 'req-6b494ea6-7289-4353-b4ea-179a637ad085'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.517278 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] The token cache is being invalidate because project e8bb56174fec40aba8e665edcd9eebc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:55.518508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.520345 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.523365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1067/2138] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:55 2022] DELETE /identity/v3/projects/e8bb56174fec40aba8e665edcd9eebc6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:55.529149 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fe4ac-2938-4cca-ab5d-143916056a69 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:55.540658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fe4ac-2938-4cca-ab5d-143916056a69 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:55.601747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:55.603602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:55.616872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee790a38-6871-4048-b0d3-123202c4616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:55.617526 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee790a38-6871-4048-b0d3-123202c4616c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:55.617812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee790a38-6871-4048-b0d3-123202c4616c admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:55.618331 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee790a38-6871-4048-b0d3-123202c4616c admin admin] PATH_INFO: `/v3/users/fe2580e3ec7f4352898da6a7249d3341` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:55.620181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee790a38-6871-4048-b0d3-123202c4616c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2580e3ec7f4352898da6a7249d3341)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:55.622562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee790a38-6871-4048-b0d3-123202c4616c admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:55.682903 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ee790a38-6871-4048-b0d3-123202c4616c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2580e3ec7f4352898da6a7249d3341'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.688634 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b494ea6-7289-4353-b4ea-179a637ad085 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:55.690339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ee790a38-6871-4048-b0d3-123202c4616c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2580e3ec7f4352898da6a7249d3341'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.697747 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:55.698555 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:55.698838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:55.699157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] PATH_INFO: `/v3/projects/7faeb26874b44279bbe4c40a7d689767` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:55.700456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7faeb26874b44279bbe4c40a7d689767)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:55.701869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ee790a38-6871-4048-b0d3-123202c4616c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2580e3ec7f4352898da6a7249d3341'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.702620 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:55.702851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ee790a38-6871-4048-b0d3-123202c4616c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2580e3ec7f4352898da6a7249d3341'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.719839 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ee790a38-6871-4048-b0d3-123202c4616c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2580e3ec7f4352898da6a7249d3341'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.727645 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1072/2139] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:55 2022] DELETE /identity/v3/users/fe2580e3ec7f4352898da6a7249d3341 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:55.767840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7faeb26874b44279bbe4c40a7d689767', 'request_id': 'req-52c63180-30ec-4e89-a642-15378a92c76b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.775687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7faeb26874b44279bbe4c40a7d689767', 'request_id': 'req-52c63180-30ec-4e89-a642-15378a92c76b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.783073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7faeb26874b44279bbe4c40a7d689767', 'request_id': 'req-52c63180-30ec-4e89-a642-15378a92c76b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.801074 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] The token cache is being invalidate because project 7faeb26874b44279bbe4c40a7d689767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:55.801509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.802339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-52c63180-30ec-4e89-a642-15378a92c76b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:55.805432 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1068/2140] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:55 2022] DELETE /identity/v3/projects/7faeb26874b44279bbe4c40a7d689767 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:24:55.811587 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c264b3b-cc55-47fb-8f71-5bcd43731081 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:55.812030 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c264b3b-cc55-47fb-8f71-5bcd43731081 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:55.812264 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c264b3b-cc55-47fb-8f71-5bcd43731081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:55.837493 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-9c264b3b-cc55-47fb-8f71-5bcd43731081 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:55.838821 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9c264b3b-cc55-47fb-8f71-5bcd43731081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:55.889027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:55.945475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1073/2141] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:55.953843 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b4ef-c251-4554-830e-41f1154a38c6 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:55.954166 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b4ef-c251-4554-830e-41f1154a38c6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:55.954510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b4ef-c251-4554-830e-41f1154a38c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:55.976690 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-91d1b4ef-c251-4554-830e-41f1154a38c6 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:55.977911 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-91d1b4ef-c251-4554-830e-41f1154a38c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:55.986347 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1069/2142] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:55.990842 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c264b3b-cc55-47fb-8f71-5bcd43731081 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:56.001933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c264b3b-cc55-47fb-8f71-5bcd43731081 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:56.007830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cce7b0-d4fd-416b-bcdd-e50991fccf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:56.008731 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cce7b0-d4fd-416b-bcdd-e50991fccf38 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:56.009071 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cce7b0-d4fd-416b-bcdd-e50991fccf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:56.009409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cce7b0-d4fd-416b-bcdd-e50991fccf38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:56.010243 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cce7b0-d4fd-416b-bcdd-e50991fccf38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:56.010819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cce7b0-d4fd-416b-bcdd-e50991fccf38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:56.012829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cce7b0-d4fd-416b-bcdd-e50991fccf38 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:56.035105 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1074/2143] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:56.039321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1b4ef-c251-4554-830e-41f1154a38c6 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:56.050334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1b4ef-c251-4554-830e-41f1154a38c6 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:56.057982 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccdda3-9d33-49fe-89af-0a9ef387a5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:56.059247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccdda3-9d33-49fe-89af-0a9ef387a5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:56.059851 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccdda3-9d33-49fe-89af-0a9ef387a5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:56.060577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccdda3-9d33-49fe-89af-0a9ef387a5c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:56.061424 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccdda3-9d33-49fe-89af-0a9ef387a5c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:56.064004 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccdda3-9d33-49fe-89af-0a9ef387a5c5 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:56.105395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1070/2144] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:56 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:56.106417 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cce7b0-d4fd-416b-bcdd-e50991fccf38 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:56.128925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cce7b0-d4fd-416b-bcdd-e50991fccf38 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:56.199280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a1bf1-4389-494a-af53-9f64461b8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:56.199909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a1bf1-4389-494a-af53-9f64461b8e81 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:56.200200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a1bf1-4389-494a-af53-9f64461b8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:56.200478 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a1bf1-4389-494a-af53-9f64461b8e81 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:56.201188 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a1bf1-4389-494a-af53-9f64461b8e81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:56.203120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a1bf1-4389-494a-af53-9f64461b8e81 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:56.227671 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1075/2145] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:56 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:24:56.232171 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccdda3-9d33-49fe-89af-0a9ef387a5c5 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:56.243656 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccdda3-9d33-49fe-89af-0a9ef387a5c5 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:56.249221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e585e-fd5a-4a4a-9870-246b649b05b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:56.250048 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e585e-fd5a-4a4a-9870-246b649b05b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:56.250363 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e585e-fd5a-4a4a-9870-246b649b05b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:56.250704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e585e-fd5a-4a4a-9870-246b649b05b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:56.251495 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e585e-fd5a-4a4a-9870-246b649b05b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:56.253168 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e585e-fd5a-4a4a-9870-246b649b05b8 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:56.264039 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1071/2146] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:56.269162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a1bf1-4389-494a-af53-9f64461b8e81 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:56.280827 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a1bf1-4389-494a-af53-9f64461b8e81 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:56.287107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206132c-2642-4eef-ac27-3d4635efc5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:56.287977 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206132c-2642-4eef-ac27-3d4635efc5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:56.289184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206132c-2642-4eef-ac27-3d4635efc5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:56.289394 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206132c-2642-4eef-ac27-3d4635efc5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:56.290657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206132c-2642-4eef-ac27-3d4635efc5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:56.292630 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206132c-2642-4eef-ac27-3d4635efc5ca admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:56.307787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1076/2147] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:56.311918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e585e-fd5a-4a4a-9870-246b649b05b8 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:56.324193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e585e-fd5a-4a4a-9870-246b649b05b8 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:56.329410 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8598-9979-473b-bb03-6fd1e5d7a9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:56.330137 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8598-9979-473b-bb03-6fd1e5d7a9e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:56.330415 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8598-9979-473b-bb03-6fd1e5d7a9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:56.330695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f8598-9979-473b-bb03-6fd1e5d7a9e7 admin admin] PATH_INFO: `/v3/projects/ec46b7680ef64bd890bfa0937d9a0049/users/cfa2bc7fc2964af7929d0ebe7e745015/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:56.347604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f8598-9979-473b-bb03-6fd1e5d7a9e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec46b7680ef64bd890bfa0937d9a0049, user_id=cfa2bc7fc2964af7929d0ebe7e745015, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:56.350391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f8598-9979-473b-bb03-6fd1e5d7a9e7 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:56.354360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:56.372939 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1072/2148] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:56 2022] PUT /identity/v3/projects/ec46b7680ef64bd890bfa0937d9a0049/users/cfa2bc7fc2964af7929d0ebe7e745015/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:56.380363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b5453-f3e2-4c08-857e-d8df2ea2e2ed None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:56.380741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b5453-f3e2-4c08-857e-d8df2ea2e2ed None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:56.381154 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b5453-f3e2-4c08-857e-d8df2ea2e2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:56.408337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-ca0b5453-f3e2-4c08-857e-d8df2ea2e2ed None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:56.410404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ca0b5453-f3e2-4c08-857e-d8df2ea2e2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:56.498157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1077/2149] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:56.508075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8598-9979-473b-bb03-6fd1e5d7a9e7 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:56.510360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6f1f8598-9979-473b-bb03-6fd1e5d7a9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:56.560606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b5453-f3e2-4c08-857e-d8df2ea2e2ed None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:56.562187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ca0b5453-f3e2-4c08-857e-d8df2ea2e2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:56.578469 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b5453-f3e2-4c08-857e-d8df2ea2e2ed None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:56.583403 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:56.584059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:56.584336 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:56.584613 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] PATH_INFO: `/v3/projects/b5f8eaab304e464a840f112c51d7d47d` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:56.586468 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f8eaab304e464a840f112c51d7d47d)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:56.588593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:56.601297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f8598-9979-473b-bb03-6fd1e5d7a9e7 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:56.605095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac20db0-f939-41f6-9c55-dc4f7959300f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:56.605722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20db0-f939-41f6-9c55-dc4f7959300f service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:56.606029 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20db0-f939-41f6-9c55-dc4f7959300f service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:56.606383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20db0-f939-41f6-9c55-dc4f7959300f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:56.616377 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac20db0-f939-41f6-9c55-dc4f7959300f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:56.618101 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac20db0-f939-41f6-9c55-dc4f7959300f service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:56.631225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:56.632905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1073/2150] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:56.642510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f8eaab304e464a840f112c51d7d47d', 'request_id': 'req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:56.649913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f8eaab304e464a840f112c51d7d47d', 'request_id': 'req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:56.658103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f8eaab304e464a840f112c51d7d47d', 'request_id': 'req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:56.680810 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] The token cache is being invalidate because project b5f8eaab304e464a840f112c51d7d47d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:56.681287 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:56.682375 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:56.685092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1078/2151] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:56 2022] DELETE /identity/v3/projects/b5f8eaab304e464a840f112c51d7d47d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:56.690657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac20db0-f939-41f6-9c55-dc4f7959300f service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:56.701319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac20db0-f939-41f6-9c55-dc4f7959300f service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:56.775025 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff1252-bb65-4ffc-8b87-2564bd9501bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:56.775975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff1252-bb65-4ffc-8b87-2564bd9501bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:56.776396 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff1252-bb65-4ffc-8b87-2564bd9501bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:56.776810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff1252-bb65-4ffc-8b87-2564bd9501bb admin admin] PATH_INFO: `/v3/users/12c1bb35fbc64253bce629f613febbf0` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:56.778634 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff1252-bb65-4ffc-8b87-2564bd9501bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c1bb35fbc64253bce629f613febbf0)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:56.781939 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff1252-bb65-4ffc-8b87-2564bd9501bb admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:56.848583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-afff1252-bb65-4ffc-8b87-2564bd9501bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c1bb35fbc64253bce629f613febbf0'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:56.849406 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-afff1252-bb65-4ffc-8b87-2564bd9501bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c1bb35fbc64253bce629f613febbf0'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:56.859021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-afff1252-bb65-4ffc-8b87-2564bd9501bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c1bb35fbc64253bce629f613febbf0'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:56.875706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-afff1252-bb65-4ffc-8b87-2564bd9501bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c1bb35fbc64253bce629f613febbf0'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:56.876539 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-afff1252-bb65-4ffc-8b87-2564bd9501bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c1bb35fbc64253bce629f613febbf0'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:56.891588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1074/2152] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:24:56 2022] DELETE /identity/v3/users/12c1bb35fbc64253bce629f613febbf0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:57.299707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:57.301712 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:57.332571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b0a96-0d80-40da-b698-0cd35dd67e7b admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:57.409270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f51cc-b615-45d9-98bc-e72de8e6e11d None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:57.409735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f51cc-b615-45d9-98bc-e72de8e6e11d None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:57.410223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f51cc-b615-45d9-98bc-e72de8e6e11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:57.448497 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:57.449321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:57.449698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:57.450158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] PATH_INFO: `/v3/projects/e534aa662250413795ed218e776292c0` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:57.451605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e534aa662250413795ed218e776292c0)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:57.453679 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-ab9f51cc-b615-45d9-98bc-e72de8e6e11d None None] MFA Rules not processed for user `cfa2bc7fc2964af7929d0ebe7e745015`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:57.453865 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:57.454954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ab9f51cc-b615-45d9-98bc-e72de8e6e11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:57.459333 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:57.521420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e534aa662250413795ed218e776292c0', 'request_id': 'req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:57.530091 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e534aa662250413795ed218e776292c0', 'request_id': 'req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:57.536709 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e534aa662250413795ed218e776292c0', 'request_id': 'req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:57.564305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] The token cache is being invalidate because project e534aa662250413795ed218e776292c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:24:57.564666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:57.571584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-aa42a7aa-51f4-4f92-b09d-2297bfcbab94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:24:57.577906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1079/2153] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:24:57 2022] DELETE /identity/v3/projects/e534aa662250413795ed218e776292c0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:57.579850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f4a22-54fc-4814-bee7-67e2f84bf40d None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:57.580134 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f4a22-54fc-4814-bee7-67e2f84bf40d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:57.580411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f4a22-54fc-4814-bee7-67e2f84bf40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:57.604349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-c28f4a22-54fc-4814-bee7-67e2f84bf40d None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:57.605891 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c28f4a22-54fc-4814-bee7-67e2f84bf40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:57.619777 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1075/2154] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:57.623489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f51cc-b615-45d9-98bc-e72de8e6e11d None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:57.626202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ab9f51cc-b615-45d9-98bc-e72de8e6e11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:57.671978 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:57.711661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1080/2155] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:57.713584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6a17c-6799-4b33-9e38-fb65d7b62b51 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:57.714182 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6a17c-6799-4b33-9e38-fb65d7b62b51 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:57.714643 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6a17c-6799-4b33-9e38-fb65d7b62b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:57.738459 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f51cc-b615-45d9-98bc-e72de8e6e11d None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:57.743101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d0a6a17c-6799-4b33-9e38-fb65d7b62b51 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:57.744603 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d0a6a17c-6799-4b33-9e38-fb65d7b62b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:57.755522 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1081/2156] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:57.760717 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6a17c-6799-4b33-9e38-fb65d7b62b51 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:57.778748 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6a17c-6799-4b33-9e38-fb65d7b62b51 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:57.786622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319d54-b2c3-42b2-b7ef-db4bc59a8e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:57.787601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319d54-b2c3-42b2-b7ef-db4bc59a8e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:57.789140 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319d54-b2c3-42b2-b7ef-db4bc59a8e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:57.789686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae319d54-b2c3-42b2-b7ef-db4bc59a8e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:57.790957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae319d54-b2c3-42b2-b7ef-db4bc59a8e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:24:57.791472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae319d54-b2c3-42b2-b7ef-db4bc59a8e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:57.794923 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae319d54-b2c3-42b2-b7ef-db4bc59a8e31 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:57.815155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1082/2157] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:24:57.823103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319d54-b2c3-42b2-b7ef-db4bc59a8e31 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:57.841908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae319d54-b2c3-42b2-b7ef-db4bc59a8e31 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:57.847590 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b174f-8acb-4d5e-9e39-9e9f8e221685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:57.848682 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b174f-8acb-4d5e-9e39-9e9f8e221685 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:57.849109 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b174f-8acb-4d5e-9e39-9e9f8e221685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:57.849530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b174f-8acb-4d5e-9e39-9e9f8e221685 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:57.851401 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b174f-8acb-4d5e-9e39-9e9f8e221685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:57.853270 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac96b8b-df94-4ace-bbaa-c75f33d342c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:57.853632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b174f-8acb-4d5e-9e39-9e9f8e221685 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:57.854452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96b8b-df94-4ace-bbaa-c75f33d342c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:57.855001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96b8b-df94-4ace-bbaa-c75f33d342c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:57.855548 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96b8b-df94-4ace-bbaa-c75f33d342c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:57.860418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2ac96b8b-df94-4ace-bbaa-c75f33d342c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:57.897584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1083/2158] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:57 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:57.902407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b174f-8acb-4d5e-9e39-9e9f8e221685 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:57.958805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac96b8b-df94-4ace-bbaa-c75f33d342c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:57.961882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac96b8b-df94-4ace-bbaa-c75f33d342c7 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:57.979406 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1076/2159] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:58.009378 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b174f-8acb-4d5e-9e39-9e9f8e221685 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:58.014202 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93c65a-d984-4de2-83ab-525c4a459d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:58.015084 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93c65a-d984-4de2-83ab-525c4a459d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.015420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93c65a-d984-4de2-83ab-525c4a459d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.015712 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca93c65a-d984-4de2-83ab-525c4a459d46 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.016332 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93c65a-d984-4de2-83ab-525c4a459d46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:58.018285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca93c65a-d984-4de2-83ab-525c4a459d46 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:58.042971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1084/2160] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:57 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:58.047368 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac96b8b-df94-4ace-bbaa-c75f33d342c7 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:58.061879 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac96b8b-df94-4ace-bbaa-c75f33d342c7 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:58.067642 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c706a8-5522-45cc-9107-d462a1d6b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:58.068370 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c706a8-5522-45cc-9107-d462a1d6b614 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.068734 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c706a8-5522-45cc-9107-d462a1d6b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.069073 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c706a8-5522-45cc-9107-d462a1d6b614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.070106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c706a8-5522-45cc-9107-d462a1d6b614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:58.072020 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c706a8-5522-45cc-9107-d462a1d6b614 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:58.085925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1077/2161] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:58.090301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93c65a-d984-4de2-83ab-525c4a459d46 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:58.102747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca93c65a-d984-4de2-83ab-525c4a459d46 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:58.108685 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cbb05-c081-490a-a2e0-8ee25a5a70b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:58.109857 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cbb05-c081-490a-a2e0-8ee25a5a70b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.110195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cbb05-c081-490a-a2e0-8ee25a5a70b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.110484 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cbb05-c081-490a-a2e0-8ee25a5a70b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.111303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cbb05-c081-490a-a2e0-8ee25a5a70b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:58.113823 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633cbb05-c081-490a-a2e0-8ee25a5a70b8 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:58.124875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1085/2162] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:58.129718 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c706a8-5522-45cc-9107-d462a1d6b614 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:58.136590 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:58.141008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c706a8-5522-45cc-9107-d462a1d6b614 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:58.168382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf02cc-fb28-4b6d-a933-c3012773c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:58.169595 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf02cc-fb28-4b6d-a933-c3012773c0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.170110 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf02cc-fb28-4b6d-a933-c3012773c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.170632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf02cc-fb28-4b6d-a933-c3012773c0cd admin admin] PATH_INFO: `/v3/projects/150dbc561ca74fae9f1a565212cc3cef/users/31df39f66e274d509709136a51d5b06f/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.197589 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf02cc-fb28-4b6d-a933-c3012773c0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=150dbc561ca74fae9f1a565212cc3cef, user_id=31df39f66e274d509709136a51d5b06f, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:58.201444 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf02cc-fb28-4b6d-a933-c3012773c0cd admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:58.221528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1078/2163] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:58 2022] PUT /identity/v3/projects/150dbc561ca74fae9f1a565212cc3cef/users/31df39f66e274d509709136a51d5b06f/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:58.233632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da08cb-d4e2-45ca-9fc9-2bd13cc2408a None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.233952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da08cb-d4e2-45ca-9fc9-2bd13cc2408a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.234318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da08cb-d4e2-45ca-9fc9-2bd13cc2408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.270774 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-c5da08cb-d4e2-45ca-9fc9-2bd13cc2408a None None] MFA Rules not processed for user `31df39f66e274d509709136a51d5b06f`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:58.272055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c5da08cb-d4e2-45ca-9fc9-2bd13cc2408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:58.361907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1086/2164] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:24:58.366021 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf02cc-fb28-4b6d-a933-c3012773c0cd admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:58.432928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf02cc-fb28-4b6d-a933-c3012773c0cd admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:58.437671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d3c9c-62d7-4083-be39-d9256fb838f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:58.438325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d3c9c-62d7-4083-be39-d9256fb838f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.438609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d3c9c-62d7-4083-be39-d9256fb838f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.438898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d3c9c-62d7-4083-be39-d9256fb838f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.439617 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d3c9c-62d7-4083-be39-d9256fb838f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:58.441528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d3c9c-62d7-4083-be39-d9256fb838f9 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:58.468470 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1079/2165] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:24:58 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:58.472843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da08cb-d4e2-45ca-9fc9-2bd13cc2408a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:58.484531 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da08cb-d4e2-45ca-9fc9-2bd13cc2408a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:58.503160 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:58.543955 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c349945-c9b0-4fef-a918-18a8be3e7c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:58.544571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c349945-c9b0-4fef-a918-18a8be3e7c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.544850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c349945-c9b0-4fef-a918-18a8be3e7c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.545127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c349945-c9b0-4fef-a918-18a8be3e7c0c admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.545786 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c349945-c9b0-4fef-a918-18a8be3e7c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:58.547725 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c349945-c9b0-4fef-a918-18a8be3e7c0c admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:58.574586 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1087/2166] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:24:58 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:24:58.577081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d3c9c-62d7-4083-be39-d9256fb838f9 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:58.589709 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d3c9c-62d7-4083-be39-d9256fb838f9 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:58.596135 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a63d6-adef-4e07-84d1-36b91ec8f0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:58.596755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a63d6-adef-4e07-84d1-36b91ec8f0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.597030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a63d6-adef-4e07-84d1-36b91ec8f0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.597302 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a63d6-adef-4e07-84d1-36b91ec8f0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.597999 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a63d6-adef-4e07-84d1-36b91ec8f0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:58.599625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a63d6-adef-4e07-84d1-36b91ec8f0e2 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:58.611218 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1080/2167] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:24:58.616008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c349945-c9b0-4fef-a918-18a8be3e7c0c admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:58.627431 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c349945-c9b0-4fef-a918-18a8be3e7c0c admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:58.632302 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893d4c-c61c-4503-94a2-082c0a9e8359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:58.632961 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893d4c-c61c-4503-94a2-082c0a9e8359 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.633242 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893d4c-c61c-4503-94a2-082c0a9e8359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.633570 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893d4c-c61c-4503-94a2-082c0a9e8359 admin admin] PATH_INFO: `/v3/projects/5f2c75ecd92c412b91a8cf23e2c29c77/users/da2a544229d6455a82fda8daadf2e608/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.650280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6893d4c-c61c-4503-94a2-082c0a9e8359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2c75ecd92c412b91a8cf23e2c29c77, user_id=da2a544229d6455a82fda8daadf2e608, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:58.653201 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6893d4c-c61c-4503-94a2-082c0a9e8359 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:58.667565 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1088/2168] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:58 2022] PUT /identity/v3/projects/5f2c75ecd92c412b91a8cf23e2c29c77/users/da2a544229d6455a82fda8daadf2e608/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:58.671804 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a63d6-adef-4e07-84d1-36b91ec8f0e2 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:58.684101 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a63d6-adef-4e07-84d1-36b91ec8f0e2 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:58.745825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5595fe-40ff-4653-8152-bdd7615ff773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:58.746387 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5595fe-40ff-4653-8152-bdd7615ff773 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.746670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5595fe-40ff-4653-8152-bdd7615ff773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.746947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5595fe-40ff-4653-8152-bdd7615ff773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.747644 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5595fe-40ff-4653-8152-bdd7615ff773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:58.749228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5595fe-40ff-4653-8152-bdd7615ff773 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:58.759753 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1081/2169] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:24:58.764175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893d4c-c61c-4503-94a2-082c0a9e8359 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:58.775018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893d4c-c61c-4503-94a2-082c0a9e8359 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:58.780245 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61098c-6cdc-4833-bdd1-eda50edc17f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:58.780909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61098c-6cdc-4833-bdd1-eda50edc17f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.781191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61098c-6cdc-4833-bdd1-eda50edc17f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.781495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61098c-6cdc-4833-bdd1-eda50edc17f6 admin admin] PATH_INFO: `/v3/projects/5f2c75ecd92c412b91a8cf23e2c29c77/users/da2a544229d6455a82fda8daadf2e608/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.783768 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61098c-6cdc-4833-bdd1-eda50edc17f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2c75ecd92c412b91a8cf23e2c29c77, user_id=da2a544229d6455a82fda8daadf2e608, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:58.786453 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61098c-6cdc-4833-bdd1-eda50edc17f6 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:58.797420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1089/2170] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:24:58 2022] PUT /identity/v3/projects/5f2c75ecd92c412b91a8cf23e2c29c77/users/da2a544229d6455a82fda8daadf2e608/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:24:58.809163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7593f5-e1fd-4c95-8b4e-a82982760afb None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.809448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7593f5-e1fd-4c95-8b4e-a82982760afb None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.809733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7593f5-e1fd-4c95-8b4e-a82982760afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:58.838890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-af7593f5-e1fd-4c95-8b4e-a82982760afb None None] MFA Rules not processed for user `da2a544229d6455a82fda8daadf2e608`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:58.840120 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-af7593f5-e1fd-4c95-8b4e-a82982760afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:58.880272 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:24:58.909660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1082/2171] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:24:58.921520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61098c-6cdc-4833-bdd1-eda50edc17f6 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:24:58.923271 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-2c61098c-6cdc-4833-bdd1-eda50edc17f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:58.983830 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61098c-6cdc-4833-bdd1-eda50edc17f6 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:24:58.987561 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9ac44-3b1f-47cf-a266-840592219b5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:24:58.988181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9ac44-3b1f-47cf-a266-840592219b5d service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:58.988464 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9ac44-3b1f-47cf-a266-840592219b5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:58.988741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9ac44-3b1f-47cf-a266-840592219b5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:59.063006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9ac44-3b1f-47cf-a266-840592219b5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:24:59.064454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9ac44-3b1f-47cf-a266-840592219b5d service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:24:59.075365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1090/2172] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:24:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:24:59.439343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421758d-d36a-4dcf-a3ca-6a1cf0c69307 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:24:59.439504 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421758d-d36a-4dcf-a3ca-6a1cf0c69307 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:24:59.439742 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421758d-d36a-4dcf-a3ca-6a1cf0c69307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:24:59.468465 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-b421758d-d36a-4dcf-a3ca-6a1cf0c69307 None None] MFA Rules not processed for user `cfa2bc7fc2964af7929d0ebe7e745015`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:24:59.469692 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b421758d-d36a-4dcf-a3ca-6a1cf0c69307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:24:59.544944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1083/2173] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:24:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:01.823883 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9ac44-3b1f-47cf-a266-840592219b5d service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:01.896924 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:01.954945 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9ac44-3b1f-47cf-a266-840592219b5d service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:01.967881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:01.968963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:01.969675 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:01.969996 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] PATH_INFO: `/v3/users/31df39f66e274d509709136a51d5b06f` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:01.971522 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31df39f66e274d509709136a51d5b06f)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:01.974312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:02.068718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31df39f66e274d509709136a51d5b06f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:02.078093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31df39f66e274d509709136a51d5b06f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:02.093278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31df39f66e274d509709136a51d5b06f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:02.094224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31df39f66e274d509709136a51d5b06f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:02.115248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31df39f66e274d509709136a51d5b06f'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:02.126860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1091/2174] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:25:01 2022] DELETE /identity/v3/users/31df39f66e274d509709136a51d5b06f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:02.129426 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67afeee-1573-4f32-8727-c11a3e402cf7 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:02.129426 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67afeee-1573-4f32-8727-c11a3e402cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:02.129426 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67afeee-1573-4f32-8727-c11a3e402cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:02.156128 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-f67afeee-1573-4f32-8727-c11a3e402cf7 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:02.157480 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-f67afeee-1573-4f32-8727-c11a3e402cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:02.235035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1084/2175] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:02.247557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:02.249141 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:02.405072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de46e4-66cf-4ddc-9200-96131be246c9 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:02.412609 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f880b2-5b44-464a-810e-80e0847d2434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:02.413328 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f880b2-5b44-464a-810e-80e0847d2434 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:02.417799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f880b2-5b44-464a-810e-80e0847d2434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:02.418972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f880b2-5b44-464a-810e-80e0847d2434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:02.443158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f880b2-5b44-464a-810e-80e0847d2434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:02.447342 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f880b2-5b44-464a-810e-80e0847d2434 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:02.472430 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1092/2176] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:02.974601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67afeee-1573-4f32-8727-c11a3e402cf7 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:02.976863 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-f67afeee-1573-4f32-8727-c11a3e402cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:02.998494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67afeee-1573-4f32-8727-c11a3e402cf7 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:03.005143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:03.006063 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:03.006352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:03.007175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] PATH_INFO: `/v3/projects/150dbc561ca74fae9f1a565212cc3cef` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:03.008496 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=150dbc561ca74fae9f1a565212cc3cef)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:03.010466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:03.077615 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150dbc561ca74fae9f1a565212cc3cef', 'request_id': 'req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.084181 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150dbc561ca74fae9f1a565212cc3cef', 'request_id': 'req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.090497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150dbc561ca74fae9f1a565212cc3cef', 'request_id': 'req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.103497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] The token cache is being invalidate because project 150dbc561ca74fae9f1a565212cc3cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:25:03.103785 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.104414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.106027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1085/2177] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:25:02 2022] DELETE /identity/v3/projects/150dbc561ca74fae9f1a565212cc3cef => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:25:03.110018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f880b2-5b44-464a-810e-80e0847d2434 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:03.119890 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f880b2-5b44-464a-810e-80e0847d2434 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:03.170906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:03.182939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f500116-b91f-433c-a05a-1c39c10f3b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:03.183684 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500116-b91f-433c-a05a-1c39c10f3b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:03.184032 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500116-b91f-433c-a05a-1c39c10f3b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:03.184312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500116-b91f-433c-a05a-1c39c10f3b7e admin admin] PATH_INFO: `/v3/users/da2a544229d6455a82fda8daadf2e608` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:03.185492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f500116-b91f-433c-a05a-1c39c10f3b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2a544229d6455a82fda8daadf2e608)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:03.187486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f500116-b91f-433c-a05a-1c39c10f3b7e admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:03.234848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6f500116-b91f-433c-a05a-1c39c10f3b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2a544229d6455a82fda8daadf2e608'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.242310 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6f500116-b91f-433c-a05a-1c39c10f3b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2a544229d6455a82fda8daadf2e608'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.250432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6f500116-b91f-433c-a05a-1c39c10f3b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2a544229d6455a82fda8daadf2e608'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.251191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6f500116-b91f-433c-a05a-1c39c10f3b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2a544229d6455a82fda8daadf2e608'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.265131 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6f500116-b91f-433c-a05a-1c39c10f3b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2a544229d6455a82fda8daadf2e608'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.271156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1093/2178] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:25:03 2022] DELETE /identity/v3/users/da2a544229d6455a82fda8daadf2e608 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:03.584535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:03.586952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:03.601041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:03.606455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8bf8b-3489-4ee5-989b-02ad6ddec4bf admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:03.670684 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:03.671551 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:03.671897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:03.672380 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] PATH_INFO: `/v3/projects/5f2c75ecd92c412b91a8cf23e2c29c77` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:03.674438 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2c75ecd92c412b91a8cf23e2c29c77)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:03.678040 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:03.740627 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2c75ecd92c412b91a8cf23e2c29c77', 'request_id': 'req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.747022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2c75ecd92c412b91a8cf23e2c29c77', 'request_id': 'req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.752697 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2c75ecd92c412b91a8cf23e2c29c77', 'request_id': 'req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.767841 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] The token cache is being invalidate because project 5f2c75ecd92c412b91a8cf23e2c29c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:25:03.768198 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.768865 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b5b47df5-0abb-445e-b56c-0ba151a9b1ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:03.770464 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1086/2179] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:25:03 2022] DELETE /identity/v3/projects/5f2c75ecd92c412b91a8cf23e2c29c77 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:03.776574 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af98b6-6f8d-4b4e-8529-9fbb34a959a8 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:03.777027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af98b6-6f8d-4b4e-8529-9fbb34a959a8 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:03.777634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af98b6-6f8d-4b4e-8529-9fbb34a959a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:03.800699 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d3af98b6-6f8d-4b4e-8529-9fbb34a959a8 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:03.802301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d3af98b6-6f8d-4b4e-8529-9fbb34a959a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:03.933927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1094/2180] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:03.941381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc880-5010-4d2e-ad4e-f584928f62dd None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:03.941653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc880-5010-4d2e-ad4e-f584928f62dd None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:03.942726 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc880-5010-4d2e-ad4e-f584928f62dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:03.973698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-ea6fc880-5010-4d2e-ad4e-f584928f62dd None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:03.975854 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ea6fc880-5010-4d2e-ad4e-f584928f62dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:03.986056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1087/2181] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:03.991369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af98b6-6f8d-4b4e-8529-9fbb34a959a8 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:04.004285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af98b6-6f8d-4b4e-8529-9fbb34a959a8 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:04.010551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee72dd-9632-47c2-ab40-392970d725a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:04.011263 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee72dd-9632-47c2-ab40-392970d725a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:04.011619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee72dd-9632-47c2-ab40-392970d725a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:04.012080 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee72dd-9632-47c2-ab40-392970d725a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:04.012888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee72dd-9632-47c2-ab40-392970d725a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:25:04.013284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee72dd-9632-47c2-ab40-392970d725a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:04.015253 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee72dd-9632-47c2-ab40-392970d725a4 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:04.031199 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1095/2182] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:25:04.035439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fc880-5010-4d2e-ad4e-f584928f62dd None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:04.051559 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fc880-5010-4d2e-ad4e-f584928f62dd None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:04.058291 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d23f2-64e0-4b35-ab0b-c313b75962cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:04.059106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d23f2-64e0-4b35-ab0b-c313b75962cc admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:04.059368 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d23f2-64e0-4b35-ab0b-c313b75962cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:04.059801 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d23f2-64e0-4b35-ab0b-c313b75962cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:04.060578 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d23f2-64e0-4b35-ab0b-c313b75962cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:04.063046 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d23f2-64e0-4b35-ab0b-c313b75962cc admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:04.113394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1088/2183] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:25:04 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:25:04.117409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee72dd-9632-47c2-ab40-392970d725a4 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:04.133127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee72dd-9632-47c2-ab40-392970d725a4 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:04.256736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:04.277255 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d9b19-7d4a-4871-9942-8f07d0d39ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:04.278076 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d9b19-7d4a-4871-9942-8f07d0d39ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:04.278367 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d9b19-7d4a-4871-9942-8f07d0d39ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:04.278641 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d9b19-7d4a-4871-9942-8f07d0d39ca5 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:04.279335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d9b19-7d4a-4871-9942-8f07d0d39ca5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:04.281369 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d9b19-7d4a-4871-9942-8f07d0d39ca5 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:04.323320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1096/2184] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:25:04 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:04.331337 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d23f2-64e0-4b35-ab0b-c313b75962cc admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:04.374770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d23f2-64e0-4b35-ab0b-c313b75962cc admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:04.388601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798603e-b6df-4961-b5df-6067fde20e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:04.390899 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798603e-b6df-4961-b5df-6067fde20e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:04.391187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798603e-b6df-4961-b5df-6067fde20e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:04.395886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798603e-b6df-4961-b5df-6067fde20e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:04.397825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798603e-b6df-4961-b5df-6067fde20e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:04.400000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798603e-b6df-4961-b5df-6067fde20e29 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:04.425790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1089/2185] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:04.429751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d9b19-7d4a-4871-9942-8f07d0d39ca5 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:04.451518 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d9b19-7d4a-4871-9942-8f07d0d39ca5 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:04.462832 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d0c1-2103-4ae2-8973-68750bd71689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:04.463544 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d0c1-2103-4ae2-8973-68750bd71689 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:04.463755 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d0c1-2103-4ae2-8973-68750bd71689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:04.464093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d0c1-2103-4ae2-8973-68750bd71689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:04.465177 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8d0c1-2103-4ae2-8973-68750bd71689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:04.467552 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8d0c1-2103-4ae2-8973-68750bd71689 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:04.485125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1097/2186] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:04.486596 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798603e-b6df-4961-b5df-6067fde20e29 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:04.504081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798603e-b6df-4961-b5df-6067fde20e29 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:04.513828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eaaaf-42d1-4772-a8d0-bf72b6dd8775 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:04.514479 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eaaaf-42d1-4772-a8d0-bf72b6dd8775 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:04.514829 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eaaaf-42d1-4772-a8d0-bf72b6dd8775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:04.515069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc33c7-99da-4ee1-8fd5-c354c7320606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:04.517535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc33c7-99da-4ee1-8fd5-c354c7320606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:04.518624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc33c7-99da-4ee1-8fd5-c354c7320606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:04.519487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc33c7-99da-4ee1-8fd5-c354c7320606 admin admin] PATH_INFO: `/v3/projects/5aeb6ee7b976469eb8d4a22e4691afc0/users/3fc2a9108af947d3b08af0f020bd4a99/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:04.552691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-4b0eaaaf-42d1-4772-a8d0-bf72b6dd8775 None None] MFA Rules not processed for user `ad48c627d5d142489f40584eea36a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:04.553972 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4b0eaaaf-42d1-4772-a8d0-bf72b6dd8775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:04.557040 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc33c7-99da-4ee1-8fd5-c354c7320606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aeb6ee7b976469eb8d4a22e4691afc0, user_id=3fc2a9108af947d3b08af0f020bd4a99, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:04.561956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc33c7-99da-4ee1-8fd5-c354c7320606 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:04.586088 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1090/2187] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:04 2022] PUT /identity/v3/projects/5aeb6ee7b976469eb8d4a22e4691afc0/users/3fc2a9108af947d3b08af0f020bd4a99/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:04.598608 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21480b6d-cb48-4567-a268-c793c160149c None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:04.599044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21480b6d-cb48-4567-a268-c793c160149c None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:04.599492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21480b6d-cb48-4567-a268-c793c160149c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:04.635762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1098/2188] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:25:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:04.648944 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-21480b6d-cb48-4567-a268-c793c160149c None None] MFA Rules not processed for user `3fc2a9108af947d3b08af0f020bd4a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:04.650527 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-21480b6d-cb48-4567-a268-c793c160149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:04.681860 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:04.710622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0eaaaf-42d1-4772-a8d0-bf72b6dd8775 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:04.712594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4b0eaaaf-42d1-4772-a8d0-bf72b6dd8775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:04.754695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1091/2189] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:04.759647 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21480b6d-cb48-4567-a268-c793c160149c None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:04.811290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0eaaaf-42d1-4772-a8d0-bf72b6dd8775 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:04.826492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21480b6d-cb48-4567-a268-c793c160149c None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:04.832009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f672742-df09-4b3d-9e87-6d377e6bae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:04.832639 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f672742-df09-4b3d-9e87-6d377e6bae96 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:04.832919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f672742-df09-4b3d-9e87-6d377e6bae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:04.833193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f672742-df09-4b3d-9e87-6d377e6bae96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:04.833862 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f672742-df09-4b3d-9e87-6d377e6bae96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:04.836294 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f672742-df09-4b3d-9e87-6d377e6bae96 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:04.868143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1092/2190] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:25:04 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:25:04.874503 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f672742-df09-4b3d-9e87-6d377e6bae96 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:04.907285 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f2b90-0e3b-4325-8105-6cd2dd825954 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02b653d2f5e4faca2906b2fbd1bfc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:04.907957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f2b90-0e3b-4325-8105-6cd2dd825954 service swift] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:04.908242 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f2b90-0e3b-4325-8105-6cd2dd825954 service swift] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:04.908525 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f2b90-0e3b-4325-8105-6cd2dd825954 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:04.943283 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:04.978900 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f672742-df09-4b3d-9e87-6d377e6bae96 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:04.985850 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa0227-4b3b-45d6-aea8-fb0a74012eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:04.986714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa0227-4b3b-45d6-aea8-fb0a74012eab admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:04.987008 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa0227-4b3b-45d6-aea8-fb0a74012eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:04.987280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa0227-4b3b-45d6-aea8-fb0a74012eab admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:04.987955 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa0227-4b3b-45d6-aea8-fb0a74012eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:04.989914 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa0227-4b3b-45d6-aea8-fb0a74012eab admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:05.005516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f2b90-0e3b-4325-8105-6cd2dd825954 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:05.007256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f2b90-0e3b-4325-8105-6cd2dd825954 service swift] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:05.017560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1099/2191] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 08:25:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 08:25:05.018143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1093/2192] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:25:04 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:05.023205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f2b90-0e3b-4325-8105-6cd2dd825954 service swift] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:05.041289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f2b90-0e3b-4325-8105-6cd2dd825954 service swift] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:05.048980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1533bb8-7f2e-4d3d-801a-c4920678abdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:05.049642 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533bb8-7f2e-4d3d-801a-c4920678abdd admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:05.049925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533bb8-7f2e-4d3d-801a-c4920678abdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:05.050229 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1533bb8-7f2e-4d3d-801a-c4920678abdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:05.050939 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1533bb8-7f2e-4d3d-801a-c4920678abdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:05.052773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1533bb8-7f2e-4d3d-801a-c4920678abdd admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:05.076110 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1100/2193] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:05.080415 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa0227-4b3b-45d6-aea8-fb0a74012eab admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:05.103666 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa0227-4b3b-45d6-aea8-fb0a74012eab admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:05.111490 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a14d6-3b74-43ee-8119-3d5a0ffa0710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:05.112466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a14d6-3b74-43ee-8119-3d5a0ffa0710 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:05.112890 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a14d6-3b74-43ee-8119-3d5a0ffa0710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:05.113306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a14d6-3b74-43ee-8119-3d5a0ffa0710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:05.114418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a14d6-3b74-43ee-8119-3d5a0ffa0710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:05.117972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a14d6-3b74-43ee-8119-3d5a0ffa0710 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:05.140173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1094/2194] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:05.145053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1533bb8-7f2e-4d3d-801a-c4920678abdd admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:05.165525 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1533bb8-7f2e-4d3d-801a-c4920678abdd admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:05.176128 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0b22-40ba-4d3a-bf5c-f8029cbb77f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:05.179053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0b22-40ba-4d3a-bf5c-f8029cbb77f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:05.180246 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0b22-40ba-4d3a-bf5c-f8029cbb77f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:05.181776 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0b22-40ba-4d3a-bf5c-f8029cbb77f1 admin admin] PATH_INFO: `/v3/projects/f824e29952984704bce1835fcb3371d4/users/77c990993ce947f7a566b7114b7d8997/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:05.229510 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc0b22-40ba-4d3a-bf5c-f8029cbb77f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f824e29952984704bce1835fcb3371d4, user_id=77c990993ce947f7a566b7114b7d8997, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:05.232715 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc0b22-40ba-4d3a-bf5c-f8029cbb77f1 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:05.282251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1101/2195] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:05 2022] PUT /identity/v3/projects/f824e29952984704bce1835fcb3371d4/users/77c990993ce947f7a566b7114b7d8997/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:25:05.283853 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecffed-e5d8-41d9-9025-77f1adb17f87 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:05.284133 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecffed-e5d8-41d9-9025-77f1adb17f87 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:05.284419 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecffed-e5d8-41d9-9025-77f1adb17f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:05.323158 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-63ecffed-e5d8-41d9-9025-77f1adb17f87 None None] MFA Rules not processed for user `77c990993ce947f7a566b7114b7d8997`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:05.324652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-63ecffed-e5d8-41d9-9025-77f1adb17f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:05.346949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:05.443064 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1095/2196] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:05.446104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0b22-40ba-4d3a-bf5c-f8029cbb77f1 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:05.538298 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0b22-40ba-4d3a-bf5c-f8029cbb77f1 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:05.546848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02868169-39ab-42b0-85e4-8e96564c61a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:05.547708 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02868169-39ab-42b0-85e4-8e96564c61a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:05.548319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02868169-39ab-42b0-85e4-8e96564c61a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:05.548666 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02868169-39ab-42b0-85e4-8e96564c61a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:05.549549 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02868169-39ab-42b0-85e4-8e96564c61a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:05.564979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02868169-39ab-42b0-85e4-8e96564c61a9 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:05.614909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1102/2197] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:25:05 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:05.617202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecffed-e5d8-41d9-9025-77f1adb17f87 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:05.633945 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecffed-e5d8-41d9-9025-77f1adb17f87 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:05.731840 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f068b5-7b49-4b15-8316-f2f03ee7a72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:05.732687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f068b5-7b49-4b15-8316-f2f03ee7a72b admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:05.733189 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f068b5-7b49-4b15-8316-f2f03ee7a72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:05.733569 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f068b5-7b49-4b15-8316-f2f03ee7a72b admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:05.734382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f068b5-7b49-4b15-8316-f2f03ee7a72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:05.737122 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f068b5-7b49-4b15-8316-f2f03ee7a72b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:05.775577 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1096/2198] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:25:05 2022] POST /identity/v3/users => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:05.776882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02868169-39ab-42b0-85e4-8e96564c61a9 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:05.793056 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02868169-39ab-42b0-85e4-8e96564c61a9 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:05.805634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad87380-4747-44e1-ac01-1f75f3dbe217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:05.806315 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad87380-4747-44e1-ac01-1f75f3dbe217 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:05.806698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad87380-4747-44e1-ac01-1f75f3dbe217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:05.806992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad87380-4747-44e1-ac01-1f75f3dbe217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:05.807707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad87380-4747-44e1-ac01-1f75f3dbe217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:05.811172 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad87380-4747-44e1-ac01-1f75f3dbe217 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:05.828454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1103/2199] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:05.832379 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f068b5-7b49-4b15-8316-f2f03ee7a72b admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:05.854467 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f068b5-7b49-4b15-8316-f2f03ee7a72b admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:05.875405 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714d668-da71-4955-b2e2-4966e45b71d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:05.880857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714d668-da71-4955-b2e2-4966e45b71d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:05.882960 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714d668-da71-4955-b2e2-4966e45b71d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:05.883211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714d668-da71-4955-b2e2-4966e45b71d3 admin admin] PATH_INFO: `/v3/projects/7287746107bc493d9cedea3de6ed016c/users/c82b6aefe90b48d59189c991ad3590bc/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:05.923518 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714d668-da71-4955-b2e2-4966e45b71d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7287746107bc493d9cedea3de6ed016c, user_id=c82b6aefe90b48d59189c991ad3590bc, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:05.926428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714d668-da71-4955-b2e2-4966e45b71d3 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:05.957903 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1097/2200] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:05 2022] PUT /identity/v3/projects/7287746107bc493d9cedea3de6ed016c/users/c82b6aefe90b48d59189c991ad3590bc/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:05.963926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad87380-4747-44e1-ac01-1f75f3dbe217 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:05.984991 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad87380-4747-44e1-ac01-1f75f3dbe217 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:06.011796 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a29ae-2e4d-450c-a41c-e713e8416b19 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:06.012082 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a29ae-2e4d-450c-a41c-e713e8416b19 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:06.012340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a29ae-2e4d-450c-a41c-e713e8416b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:06.042243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-694a29ae-2e4d-450c-a41c-e713e8416b19 None None] MFA Rules not processed for user `ad48c627d5d142489f40584eea36a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:06.044296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-694a29ae-2e4d-450c-a41c-e713e8416b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:06.080789 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f98f6-0e82-49c4-b387-c23b712f0f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:06.081702 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f98f6-0e82-49c4-b387-c23b712f0f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:06.082169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f98f6-0e82-49c4-b387-c23b712f0f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:06.082591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f98f6-0e82-49c4-b387-c23b712f0f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:06.083912 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f98f6-0e82-49c4-b387-c23b712f0f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:06.087258 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f98f6-0e82-49c4-b387-c23b712f0f20 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:06.096674 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:06.113028 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1104/2201] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:06.113521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1098/2202] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 2 08:25:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:06.115303 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f98f6-0e82-49c4-b387-c23b712f0f20 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:06.130917 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a29ae-2e4d-450c-a41c-e713e8416b19 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:06.136090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f98f6-0e82-49c4-b387-c23b712f0f20 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:06.149406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a844d-74b5-4ea6-bb70-cb21710e6ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:06.150921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a844d-74b5-4ea6-bb70-cb21710e6ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:06.151169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a844d-74b5-4ea6-bb70-cb21710e6ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:06.151402 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a844d-74b5-4ea6-bb70-cb21710e6ab1 admin admin] PATH_INFO: `/v3/projects/7287746107bc493d9cedea3de6ed016c/users/c82b6aefe90b48d59189c991ad3590bc/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:06.156592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a844d-74b5-4ea6-bb70-cb21710e6ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7287746107bc493d9cedea3de6ed016c, user_id=c82b6aefe90b48d59189c991ad3590bc, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:06.161081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a844d-74b5-4ea6-bb70-cb21710e6ab1 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:06.175004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1105/2203] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:06 2022] PUT /identity/v3/projects/7287746107bc493d9cedea3de6ed016c/users/c82b6aefe90b48d59189c991ad3590bc/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:06.185481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:06.187110 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf01540-6622-4003-b591-8522a7688b41 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:06.187530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf01540-6622-4003-b591-8522a7688b41 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:06.187905 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf01540-6622-4003-b591-8522a7688b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:06.231112 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-abf01540-6622-4003-b591-8522a7688b41 None None] MFA Rules not processed for user `c82b6aefe90b48d59189c991ad3590bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:06.232596 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-abf01540-6622-4003-b591-8522a7688b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:06.234755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a29ae-2e4d-450c-a41c-e713e8416b19 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:06.313733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b21ba6-6a8b-400f-98d0-2702d90d70db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02b653d2f5e4faca2906b2fbd1bfc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:06.314430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b21ba6-6a8b-400f-98d0-2702d90d70db service swift] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:06.314712 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b21ba6-6a8b-400f-98d0-2702d90d70db service swift] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:06.314988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b21ba6-6a8b-400f-98d0-2702d90d70db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:06.320240 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1106/2204] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:06.334400 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf01540-6622-4003-b591-8522a7688b41 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:06.336231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-abf01540-6622-4003-b591-8522a7688b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:06.384588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b21ba6-6a8b-400f-98d0-2702d90d70db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:06.386324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b21ba6-6a8b-400f-98d0-2702d90d70db service swift] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:06.395810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1099/2205] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 08:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:25:06.405566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf01540-6622-4003-b591-8522a7688b41 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:06.409365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf6971-48e1-43ac-9052-2a12bd343204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:06.410130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf6971-48e1-43ac-9052-2a12bd343204 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:06.410290 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf6971-48e1-43ac-9052-2a12bd343204 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:06.410598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf6971-48e1-43ac-9052-2a12bd343204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:06.476078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf6971-48e1-43ac-9052-2a12bd343204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:06.477605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf6971-48e1-43ac-9052-2a12bd343204 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:06.487619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1107/2206] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:06.800706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8b872-de05-4ebb-b33d-3e31b611ed80 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:06.801538 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8b872-de05-4ebb-b33d-3e31b611ed80 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:06.801721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8b872-de05-4ebb-b33d-3e31b611ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:06.837107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-1eb8b872-de05-4ebb-b33d-3e31b611ed80 None None] MFA Rules not processed for user `ad48c627d5d142489f40584eea36a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:06.838670 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-1eb8b872-de05-4ebb-b33d-3e31b611ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:06.847201 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1100/2207] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:25:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:06.865577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf6971-48e1-43ac-9052-2a12bd343204 service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:06.879429 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf6971-48e1-43ac-9052-2a12bd343204 service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:06.887389 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6abf01-0cfb-41d0-8302-a7c265cb6001 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02b653d2f5e4faca2906b2fbd1bfc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:06.888340 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6abf01-0cfb-41d0-8302-a7c265cb6001 service swift] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:06.888816 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6abf01-0cfb-41d0-8302-a7c265cb6001 service swift] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:06.889461 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6abf01-0cfb-41d0-8302-a7c265cb6001 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:06.900916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6abf01-0cfb-41d0-8302-a7c265cb6001 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:06.902691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6abf01-0cfb-41d0-8302-a7c265cb6001 service swift] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:06.913244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1108/2208] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 08:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 08:25:07.318866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cf9c3-aa4e-4b46-834f-8d567569e1c2 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:07.319810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cf9c3-aa4e-4b46-834f-8d567569e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:07.320093 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cf9c3-aa4e-4b46-834f-8d567569e1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:07.339482 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3c7cf9c3-aa4e-4b46-834f-8d567569e1c2 None None] MFA Rules not processed for user `ad48c627d5d142489f40584eea36a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:07.340690 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3c7cf9c3-aa4e-4b46-834f-8d567569e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:07.347882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1101/2209] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 2 08:25:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:07.362607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6abf01-0cfb-41d0-8302-a7c265cb6001 service swift] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:07.379090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6abf01-0cfb-41d0-8302-a7c265cb6001 service swift] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:07.386443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fd1f3-7332-4fba-8d27-5aea0538e77a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02b653d2f5e4faca2906b2fbd1bfc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:07.387334 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fd1f3-7332-4fba-8d27-5aea0538e77a service swift] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:07.387757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fd1f3-7332-4fba-8d27-5aea0538e77a service swift] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:07.388175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fd1f3-7332-4fba-8d27-5aea0538e77a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:07.400990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fd1f3-7332-4fba-8d27-5aea0538e77a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:07.403558 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fd1f3-7332-4fba-8d27-5aea0538e77a service swift] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:07.410745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:07.417605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1109/2210] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 08:25:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:25:08.205003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cf9c3-aa4e-4b46-834f-8d567569e1c2 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:08.206715 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3c7cf9c3-aa4e-4b46-834f-8d567569e1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:08.221307 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cf9c3-aa4e-4b46-834f-8d567569e1c2 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:08.226060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb2eb7-ada9-450f-8b7b-355817c18fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:08.226938 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb2eb7-ada9-450f-8b7b-355817c18fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:08.227430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb2eb7-ada9-450f-8b7b-355817c18fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:08.227703 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb2eb7-ada9-450f-8b7b-355817c18fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:08.305430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:08.310842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb2eb7-ada9-450f-8b7b-355817c18fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:08.312974 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb2eb7-ada9-450f-8b7b-355817c18fe7 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:08.324613 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1102/2211] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:09.003465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fd1f3-7332-4fba-8d27-5aea0538e77a service swift] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:09.013888 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fd1f3-7332-4fba-8d27-5aea0538e77a service swift] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:09.020198 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438ebde-1645-4540-901b-970f47d2bbce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:09.021233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ebde-1645-4540-901b-970f47d2bbce service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:09.022048 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ebde-1645-4540-901b-970f47d2bbce service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:09.022251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ebde-1645-4540-901b-970f47d2bbce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:09.036503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438ebde-1645-4540-901b-970f47d2bbce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:09.039036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438ebde-1645-4540-901b-970f47d2bbce service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:09.050471 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1110/2212] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:09.769364 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb2eb7-ada9-450f-8b7b-355817c18fe7 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:09.771295 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-06cb2eb7-ada9-450f-8b7b-355817c18fe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:09.856412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb2eb7-ada9-450f-8b7b-355817c18fe7 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:09.861223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:09.861887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:09.862203 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:09.862704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] PATH_INFO: `/v3/users/82e8d294c4c64f8584bbc6b442d5b26c` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:09.863967 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e8d294c4c64f8584bbc6b442d5b26c)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:09.865946 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:09.921333 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e8d294c4c64f8584bbc6b442d5b26c'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:09.922174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e8d294c4c64f8584bbc6b442d5b26c'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:09.937286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e8d294c4c64f8584bbc6b442d5b26c'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:09.961690 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e8d294c4c64f8584bbc6b442d5b26c'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:09.962900 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e8d294c4c64f8584bbc6b442d5b26c'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:09.994212 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1103/2213] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:25:09 2022] DELETE /identity/v3/users/82e8d294c4c64f8584bbc6b442d5b26c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:10.000485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2acca-e778-4f93-b29d-9aa201ec9725 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:10.000986 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2acca-e778-4f93-b29d-9aa201ec9725 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:10.001483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2acca-e778-4f93-b29d-9aa201ec9725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:10.025623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-6bb2acca-e778-4f93-b29d-9aa201ec9725 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:10.026963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-6bb2acca-e778-4f93-b29d-9aa201ec9725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:10.123233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1111/2214] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:10.134425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:10.136184 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:10.237743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2be51-e57b-4dc9-a8e2-c89b8b72eaf5 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:10.242528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5701f-9f8b-4d53-b55a-57d1e200ba26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:10.243182 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5701f-9f8b-4d53-b55a-57d1e200ba26 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:10.243507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5701f-9f8b-4d53-b55a-57d1e200ba26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:10.243770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5701f-9f8b-4d53-b55a-57d1e200ba26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:10.255557 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5701f-9f8b-4d53-b55a-57d1e200ba26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:10.258609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5701f-9f8b-4d53-b55a-57d1e200ba26 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:10.270976 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1104/2215] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:10.552046 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2acca-e778-4f93-b29d-9aa201ec9725 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:10.556186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-6bb2acca-e778-4f93-b29d-9aa201ec9725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:10.630286 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2acca-e778-4f93-b29d-9aa201ec9725 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:10.658739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:10.659416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:10.659711 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:10.660072 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] PATH_INFO: `/v3/projects/29a895181fb145e79ad055b32dd740dd` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:10.661495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a895181fb145e79ad055b32dd740dd)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:10.664354 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:10.796113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a895181fb145e79ad055b32dd740dd', 'request_id': 'req-320c1c24-f178-4f3b-afe0-87e2e0f70262'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:10.805577 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a895181fb145e79ad055b32dd740dd', 'request_id': 'req-320c1c24-f178-4f3b-afe0-87e2e0f70262'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:10.814771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a895181fb145e79ad055b32dd740dd', 'request_id': 'req-320c1c24-f178-4f3b-afe0-87e2e0f70262'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:10.830928 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] The token cache is being invalidate because project 29a895181fb145e79ad055b32dd740dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:25:10.831390 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:10.832444 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-320c1c24-f178-4f3b-afe0-87e2e0f70262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:10.834411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1112/2216] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:25:10 2022] DELETE /identity/v3/projects/29a895181fb145e79ad055b32dd740dd => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:10.839392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db416-7c95-451f-88b3-3b304d754044 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:10.840224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db416-7c95-451f-88b3-3b304d754044 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:10.840626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9db416-7c95-451f-88b3-3b304d754044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:10.869478 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-fd9db416-7c95-451f-88b3-3b304d754044 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:10.870745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-fd9db416-7c95-451f-88b3-3b304d754044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:10.880616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:10.932550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1105/2217] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:10.940458 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e0c4-8348-4455-b420-6b5992a666bb None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:10.940821 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e0c4-8348-4455-b420-6b5992a666bb None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:10.941136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6e0c4-8348-4455-b420-6b5992a666bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:10.963260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-fad6e0c4-8348-4455-b420-6b5992a666bb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:10.964407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fad6e0c4-8348-4455-b420-6b5992a666bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:10.972425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1113/2218] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:10.976933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9db416-7c95-451f-88b3-3b304d754044 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:10.986733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9db416-7c95-451f-88b3-3b304d754044 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:10.991723 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af6e33-4157-4b6a-8ad8-e05f38285bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:10.992352 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6e33-4157-4b6a-8ad8-e05f38285bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:10.992616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6e33-4157-4b6a-8ad8-e05f38285bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:10.992888 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6e33-4157-4b6a-8ad8-e05f38285bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:10.993913 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af6e33-4157-4b6a-8ad8-e05f38285bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:25:10.994240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af6e33-4157-4b6a-8ad8-e05f38285bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:10.995815 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af6e33-4157-4b6a-8ad8-e05f38285bc1 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:11.008392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1106/2219] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:25:11.012910 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6e0c4-8348-4455-b420-6b5992a666bb None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:11.022408 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6e0c4-8348-4455-b420-6b5992a666bb None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:11.027289 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18f496-8779-44e4-83d6-90d2459ca7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:11.027985 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18f496-8779-44e4-83d6-90d2459ca7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:11.028166 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18f496-8779-44e4-83d6-90d2459ca7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:11.028435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18f496-8779-44e4-83d6-90d2459ca7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:11.029106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18f496-8779-44e4-83d6-90d2459ca7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:11.031019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18f496-8779-44e4-83d6-90d2459ca7e6 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:11.059620 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1114/2220] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:25:11 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:11.063996 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af6e33-4157-4b6a-8ad8-e05f38285bc1 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:11.076126 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af6e33-4157-4b6a-8ad8-e05f38285bc1 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:11.133790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38d858-3993-48b0-97cf-c0caeafa6bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:11.134453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d858-3993-48b0-97cf-c0caeafa6bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:11.134731 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d858-3993-48b0-97cf-c0caeafa6bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:11.135001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d858-3993-48b0-97cf-c0caeafa6bfe admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:11.135674 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38d858-3993-48b0-97cf-c0caeafa6bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:11.137622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38d858-3993-48b0-97cf-c0caeafa6bfe admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:11.168143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1107/2221] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:25:11 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:11.172679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18f496-8779-44e4-83d6-90d2459ca7e6 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:11.184402 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18f496-8779-44e4-83d6-90d2459ca7e6 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:11.189344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85a4fc-aab8-45c9-a389-04a5fc843270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:11.189979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85a4fc-aab8-45c9-a389-04a5fc843270 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:11.190364 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85a4fc-aab8-45c9-a389-04a5fc843270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:11.190640 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85a4fc-aab8-45c9-a389-04a5fc843270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:11.191349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85a4fc-aab8-45c9-a389-04a5fc843270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:11.192955 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85a4fc-aab8-45c9-a389-04a5fc843270 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:11.204029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1115/2222] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:11.208130 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38d858-3993-48b0-97cf-c0caeafa6bfe admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:11.218469 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38d858-3993-48b0-97cf-c0caeafa6bfe admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:11.222954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5eb0a-939a-46b2-ad5e-74414b20b1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:11.223572 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5eb0a-939a-46b2-ad5e-74414b20b1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:11.223849 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5eb0a-939a-46b2-ad5e-74414b20b1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:11.224121 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5eb0a-939a-46b2-ad5e-74414b20b1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:11.224818 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5eb0a-939a-46b2-ad5e-74414b20b1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:11.226937 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5eb0a-939a-46b2-ad5e-74414b20b1d7 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:11.238441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1108/2223] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:11.244184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85a4fc-aab8-45c9-a389-04a5fc843270 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:11.254754 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85a4fc-aab8-45c9-a389-04a5fc843270 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:11.259503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436704b3-7dbf-4e40-89bc-be54f7e8613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:11.260179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436704b3-7dbf-4e40-89bc-be54f7e8613a admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:11.260466 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436704b3-7dbf-4e40-89bc-be54f7e8613a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:11.260747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436704b3-7dbf-4e40-89bc-be54f7e8613a admin admin] PATH_INFO: `/v3/projects/ef5a23922ef54bd7b5e7b48f737c9654/users/a3f09fb52b0843229a0ea401c3f2ef45/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:11.276495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436704b3-7dbf-4e40-89bc-be54f7e8613a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5a23922ef54bd7b5e7b48f737c9654, user_id=a3f09fb52b0843229a0ea401c3f2ef45, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:11.279556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436704b3-7dbf-4e40-89bc-be54f7e8613a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:11.293641 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1116/2224] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:11 2022] PUT /identity/v3/projects/ef5a23922ef54bd7b5e7b48f737c9654/users/a3f09fb52b0843229a0ea401c3f2ef45/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:11.304702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049581f5-3d29-48f9-b533-fad7232eb9ab None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:11.305007 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049581f5-3d29-48f9-b533-fad7232eb9ab None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:11.305305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049581f5-3d29-48f9-b533-fad7232eb9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:11.333482 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-049581f5-3d29-48f9-b533-fad7232eb9ab None None] MFA Rules not processed for user `a3f09fb52b0843229a0ea401c3f2ef45`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:11.334746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-049581f5-3d29-48f9-b533-fad7232eb9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:11.404596 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1109/2225] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:11.416813 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436704b3-7dbf-4e40-89bc-be54f7e8613a admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:11.418713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-436704b3-7dbf-4e40-89bc-be54f7e8613a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:11.429679 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:11.493998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436704b3-7dbf-4e40-89bc-be54f7e8613a admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:11.503794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10ae51-9783-4a47-b529-6059ee8e1ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:11.504420 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10ae51-9783-4a47-b529-6059ee8e1ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:11.504697 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10ae51-9783-4a47-b529-6059ee8e1ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:11.504968 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10ae51-9783-4a47-b529-6059ee8e1ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:11.526274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10ae51-9783-4a47-b529-6059ee8e1ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:11.528052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10ae51-9783-4a47-b529-6059ee8e1ec6 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:11.545439 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1117/2226] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:13.608071 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049581f5-3d29-48f9-b533-fad7232eb9ab None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:13.611233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-049581f5-3d29-48f9-b533-fad7232eb9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:13.635374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:13.712286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049581f5-3d29-48f9-b533-fad7232eb9ab None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:13.725180 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:13.726077 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:13.726762 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:13.726934 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] PATH_INFO: `/v3/users/3fc2a9108af947d3b08af0f020bd4a99` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:13.728607 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc2a9108af947d3b08af0f020bd4a99)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:13.730809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:13.804353 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc2a9108af947d3b08af0f020bd4a99'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:13.805964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc2a9108af947d3b08af0f020bd4a99'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:13.816604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc2a9108af947d3b08af0f020bd4a99'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:13.838986 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc2a9108af947d3b08af0f020bd4a99'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:13.840269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc2a9108af947d3b08af0f020bd4a99'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:13.856059 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1110/2227] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:25:13 2022] DELETE /identity/v3/users/3fc2a9108af947d3b08af0f020bd4a99 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:13.861450 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf87d19-7479-40d6-9cd7-784ab508308a None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:13.862336 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf87d19-7479-40d6-9cd7-784ab508308a None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:13.862770 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf87d19-7479-40d6-9cd7-784ab508308a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:13.891206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-fbf87d19-7479-40d6-9cd7-784ab508308a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:13.892828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fbf87d19-7479-40d6-9cd7-784ab508308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:13.992794 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1118/2228] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:14.008994 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:14.019071 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:14.111098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5184b9-9205-44c6-a717-14d840d37513 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:14.115386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cacfe-3079-4fec-a4da-488032280264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:14.117107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cacfe-3079-4fec-a4da-488032280264 service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:14.117395 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cacfe-3079-4fec-a4da-488032280264 service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:14.117761 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5cacfe-3079-4fec-a4da-488032280264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:14.127803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5cacfe-3079-4fec-a4da-488032280264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:14.130060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5cacfe-3079-4fec-a4da-488032280264 service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:14.156905 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1111/2229] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:14.660929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf87d19-7479-40d6-9cd7-784ab508308a None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:14.660929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fbf87d19-7479-40d6-9cd7-784ab508308a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:14.673915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf87d19-7479-40d6-9cd7-784ab508308a None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:14.680460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:14.680925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:14.681370 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:14.681716 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] PATH_INFO: `/v3/projects/5aeb6ee7b976469eb8d4a22e4691afc0` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:14.683260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aeb6ee7b976469eb8d4a22e4691afc0)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:14.689974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:14.756828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aeb6ee7b976469eb8d4a22e4691afc0', 'request_id': 'req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:14.768843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aeb6ee7b976469eb8d4a22e4691afc0', 'request_id': 'req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:14.777150 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aeb6ee7b976469eb8d4a22e4691afc0', 'request_id': 'req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:14.802492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] The token cache is being invalidate because project 5aeb6ee7b976469eb8d4a22e4691afc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:25:14.803497 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:14.804031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:14.806228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1119/2230] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:25:14 2022] DELETE /identity/v3/projects/5aeb6ee7b976469eb8d4a22e4691afc0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:14.810033 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cacfe-3079-4fec-a4da-488032280264 service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:14.822993 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5cacfe-3079-4fec-a4da-488032280264 service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:14.879207 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:14.915149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:14.915919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:14.916288 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:14.916629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] PATH_INFO: `/v3/users/77c990993ce947f7a566b7114b7d8997` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:14.917922 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c990993ce947f7a566b7114b7d8997)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:14.920014 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:14.998094 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c990993ce947f7a566b7114b7d8997'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:14.998838 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c990993ce947f7a566b7114b7d8997'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.022693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c990993ce947f7a566b7114b7d8997'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.038507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c990993ce947f7a566b7114b7d8997'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.039415 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c990993ce947f7a566b7114b7d8997'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.053773 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1112/2231] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:25:14 2022] DELETE /identity/v3/users/77c990993ce947f7a566b7114b7d8997 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:15.457184 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:15.458909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:15.476111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e408-ea4a-4089-bcf9-ee4b6807cdc9 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:15.524688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:15.564663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:15.565443 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:15.565799 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:15.566226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] PATH_INFO: `/v3/projects/f824e29952984704bce1835fcb3371d4` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:15.568344 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f824e29952984704bce1835fcb3371d4)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:15.571120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:15.660969 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f824e29952984704bce1835fcb3371d4', 'request_id': 'req-78952f0c-e485-4b32-b9f1-4f284a6e9943'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.678775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f824e29952984704bce1835fcb3371d4', 'request_id': 'req-78952f0c-e485-4b32-b9f1-4f284a6e9943'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.686995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f824e29952984704bce1835fcb3371d4', 'request_id': 'req-78952f0c-e485-4b32-b9f1-4f284a6e9943'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.705173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] The token cache is being invalidate because project f824e29952984704bce1835fcb3371d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:25:15.706357 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.707762 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.711831 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1120/2232] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:25:15 2022] DELETE /identity/v3/projects/f824e29952984704bce1835fcb3371d4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:15.716819 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:15.719105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:15.737945 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834ce6b-f132-479c-81b8-0bd53b520a6e admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:15.825649 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:15.829616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:15.829886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:15.830401 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] PATH_INFO: `/v3/users/c82b6aefe90b48d59189c991ad3590bc` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:15.831945 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82b6aefe90b48d59189c991ad3590bc)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:15.833884 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:15.895366 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82b6aefe90b48d59189c991ad3590bc'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.896687 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82b6aefe90b48d59189c991ad3590bc'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.910829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82b6aefe90b48d59189c991ad3590bc'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.915224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:15.933522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82b6aefe90b48d59189c991ad3590bc'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.935908 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82b6aefe90b48d59189c991ad3590bc'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:15.960981 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1113/2233] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:25:15 2022] DELETE /identity/v3/users/c82b6aefe90b48d59189c991ad3590bc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:25:16.047341 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:16.049780 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:16.085156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78952f0c-e485-4b32-b9f1-4f284a6e9943 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:16.154235 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d9096-37a3-4cca-a025-9cf27b79f77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:16.155169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9096-37a3-4cca-a025-9cf27b79f77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:16.155511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9096-37a3-4cca-a025-9cf27b79f77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:16.155851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d9096-37a3-4cca-a025-9cf27b79f77a admin admin] PATH_INFO: `/v3/users/2ce8f85c676447d5b15770c4c64d4237` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:16.157135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d9096-37a3-4cca-a025-9cf27b79f77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce8f85c676447d5b15770c4c64d4237)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:16.159200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d9096-37a3-4cca-a025-9cf27b79f77a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:16.219027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-747d9096-37a3-4cca-a025-9cf27b79f77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce8f85c676447d5b15770c4c64d4237'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:16.226448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-747d9096-37a3-4cca-a025-9cf27b79f77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce8f85c676447d5b15770c4c64d4237'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:16.244351 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-747d9096-37a3-4cca-a025-9cf27b79f77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce8f85c676447d5b15770c4c64d4237'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:16.245030 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-747d9096-37a3-4cca-a025-9cf27b79f77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce8f85c676447d5b15770c4c64d4237'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:16.248588 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:16.264023 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-747d9096-37a3-4cca-a025-9cf27b79f77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce8f85c676447d5b15770c4c64d4237'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:16.271099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1121/2234] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:25:16 2022] DELETE /identity/v3/users/2ce8f85c676447d5b15770c4c64d4237 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:16.463695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:16.465238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:16.478988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e17fc9-6b5a-4b08-a96a-5076e723da67 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:16.553880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:16.554626 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:16.554867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:16.555115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] PATH_INFO: `/v3/projects/d89a7bc869334c58bae86805b41314ff` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:16.556403 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89a7bc869334c58bae86805b41314ff)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:16.558603 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:16.618654 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89a7bc869334c58bae86805b41314ff', 'request_id': 'req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:16.625253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89a7bc869334c58bae86805b41314ff', 'request_id': 'req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:16.631409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89a7bc869334c58bae86805b41314ff', 'request_id': 'req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:16.645262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] The token cache is being invalidate because project d89a7bc869334c58bae86805b41314ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:25:16.645560 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:16.646267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-5a5cfac7-933f-4cd9-abae-0cc2d1fd0266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:16.649074 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1114/2235] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:25:16 2022] DELETE /identity/v3/projects/d89a7bc869334c58bae86805b41314ff => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:16.654315 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f9cb3-f58d-44d9-8dcf-f9574f172857 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:16.655327 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f9cb3-f58d-44d9-8dcf-f9574f172857 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:16.655563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f9cb3-f58d-44d9-8dcf-f9574f172857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:16.676048 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-7f2f9cb3-f58d-44d9-8dcf-f9574f172857 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:16.677411 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7f2f9cb3-f58d-44d9-8dcf-f9574f172857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:16.744172 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1122/2236] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:16.751928 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a02412-7f71-4914-ba13-8073d8ee2268 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:16.752221 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a02412-7f71-4914-ba13-8073d8ee2268 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:16.752525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a02412-7f71-4914-ba13-8073d8ee2268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:16.774430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-35a02412-7f71-4914-ba13-8073d8ee2268 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:16.775672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-35a02412-7f71-4914-ba13-8073d8ee2268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:16.784360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1115/2237] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:16.788695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f9cb3-f58d-44d9-8dcf-f9574f172857 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:16.799178 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f9cb3-f58d-44d9-8dcf-f9574f172857 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:16.804631 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82595860-a5b7-4358-bc23-4f15bac449df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:16.805383 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82595860-a5b7-4358-bc23-4f15bac449df admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:16.805730 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82595860-a5b7-4358-bc23-4f15bac449df admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:16.806154 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82595860-a5b7-4358-bc23-4f15bac449df admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:16.806933 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82595860-a5b7-4358-bc23-4f15bac449df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:25:16.807313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82595860-a5b7-4358-bc23-4f15bac449df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:16.809081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82595860-a5b7-4358-bc23-4f15bac449df admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:16.833591 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1123/2238] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:25:16.834963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a02412-7f71-4914-ba13-8073d8ee2268 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:16.844675 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a02412-7f71-4914-ba13-8073d8ee2268 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:16.849546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e6b80-0097-47e6-be57-96658e476ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:16.850198 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e6b80-0097-47e6-be57-96658e476ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:16.850479 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e6b80-0097-47e6-be57-96658e476ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:16.850752 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e6b80-0097-47e6-be57-96658e476ce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:16.851423 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e6b80-0097-47e6-be57-96658e476ce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:16.853304 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e6b80-0097-47e6-be57-96658e476ce4 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:16.883530 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1116/2239] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:25:16 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:16.888439 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82595860-a5b7-4358-bc23-4f15bac449df admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:16.894866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e6b80-0097-47e6-be57-96658e476ce4 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:16.896995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ed7e6b80-0097-47e6-be57-96658e476ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:16.900044 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82595860-a5b7-4358-bc23-4f15bac449df admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:16.941187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:16.965158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5567374-c677-400d-8a37-4bdb08ebecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:16.965778 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567374-c677-400d-8a37-4bdb08ebecbe admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:16.966090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567374-c677-400d-8a37-4bdb08ebecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:16.966374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567374-c677-400d-8a37-4bdb08ebecbe admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:16.967036 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5567374-c677-400d-8a37-4bdb08ebecbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:16.968962 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5567374-c677-400d-8a37-4bdb08ebecbe admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:16.974918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e6b80-0097-47e6-be57-96658e476ce4 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:16.980579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:16.981269 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:16.981586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:16.982083 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] PATH_INFO: `/v3/projects/7287746107bc493d9cedea3de6ed016c` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:16.983440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7287746107bc493d9cedea3de6ed016c)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:16.985614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:16.993002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1124/2240] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:25:16 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:16.996661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5567374-c677-400d-8a37-4bdb08ebecbe admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.006801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5567374-c677-400d-8a37-4bdb08ebecbe admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.011623 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60880436-0239-4667-80c7-9aa93d8530bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.012294 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60880436-0239-4667-80c7-9aa93d8530bf admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.012614 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60880436-0239-4667-80c7-9aa93d8530bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.012941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60880436-0239-4667-80c7-9aa93d8530bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.014801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60880436-0239-4667-80c7-9aa93d8530bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.015425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60880436-0239-4667-80c7-9aa93d8530bf admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:17.027494 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1125/2241] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:25:17.033207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60880436-0239-4667-80c7-9aa93d8530bf admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.043128 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60880436-0239-4667-80c7-9aa93d8530bf admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.045679 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7287746107bc493d9cedea3de6ed016c', 'request_id': 'req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:17.052724 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7287746107bc493d9cedea3de6ed016c', 'request_id': 'req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:17.059372 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7287746107bc493d9cedea3de6ed016c', 'request_id': 'req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:17.075797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] The token cache is being invalidate because project 7287746107bc493d9cedea3de6ed016c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:25:17.076261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:17.077238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b6593168-bc1d-4caa-b4b3-8a7be3509b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:17.078825 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1117/2242] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:25:16 2022] DELETE /identity/v3/projects/7287746107bc493d9cedea3de6ed016c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:25:17.083572 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5d99-4e7b-4619-9713-706ac58f340e None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.083867 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5d99-4e7b-4619-9713-706ac58f340e None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.084286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5d99-4e7b-4619-9713-706ac58f340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.093313 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:17.105455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-edbf5d99-4e7b-4619-9713-706ac58f340e None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:17.106711 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-edbf5d99-4e7b-4619-9713-706ac58f340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:17.107989 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcf04c-cf04-4889-9f49-3506a50f2a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.108611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf04c-cf04-4889-9f49-3506a50f2a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.108892 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf04c-cf04-4889-9f49-3506a50f2a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.109169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcf04c-cf04-4889-9f49-3506a50f2a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.109897 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcf04c-cf04-4889-9f49-3506a50f2a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.111563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcf04c-cf04-4889-9f49-3506a50f2a5b admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:17.114779 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1118/2243] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:17.122425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1126/2244] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:25:17.126428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf5d99-4e7b-4619-9713-706ac58f340e None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.128032 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-edbf5d99-4e7b-4619-9713-706ac58f340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:17.146075 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf5d99-4e7b-4619-9713-706ac58f340e None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.147744 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4a01-73c1-46bd-86c1-277d4fb43f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.148451 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4a01-73c1-46bd-86c1-277d4fb43f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.148729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4a01-73c1-46bd-86c1-277d4fb43f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.149003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4a01-73c1-46bd-86c1-277d4fb43f8c admin admin] PATH_INFO: `/v3/projects/75a82e981d0e4bcd81bfca9ed544f62d/users/16f10d286d6e4233bafa05c05f00bb20/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.170781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b4a01-73c1-46bd-86c1-277d4fb43f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a82e981d0e4bcd81bfca9ed544f62d, user_id=16f10d286d6e4233bafa05c05f00bb20, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.173528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b4a01-73c1-46bd-86c1-277d4fb43f8c admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:17.190494 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ae11-48c1-4bec-ab7a-57064c02eadb None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.190915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ae11-48c1-4bec-ab7a-57064c02eadb None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.191295 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418ae11-48c1-4bec-ab7a-57064c02eadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.192350 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1119/2245] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:17 2022] PUT /identity/v3/projects/75a82e981d0e4bcd81bfca9ed544f62d/users/16f10d286d6e4233bafa05c05f00bb20/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:25:17.202772 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b7b5e-9f2c-4f88-b819-a80bd451b2b5 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.203068 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b7b5e-9f2c-4f88-b819-a80bd451b2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.203349 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b7b5e-9f2c-4f88-b819-a80bd451b2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.213291 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-7418ae11-48c1-4bec-ab7a-57064c02eadb None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:17.214547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-7418ae11-48c1-4bec-ab7a-57064c02eadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:17.234389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-b62b7b5e-9f2c-4f88-b819-a80bd451b2b5 None None] MFA Rules not processed for user `16f10d286d6e4233bafa05c05f00bb20`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:17.235930 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b62b7b5e-9f2c-4f88-b819-a80bd451b2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:17.283092 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1127/2246] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:17.287750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418ae11-48c1-4bec-ab7a-57064c02eadb None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.296735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418ae11-48c1-4bec-ab7a-57064c02eadb None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.301476 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daee52-3fd8-4dd2-a7b4-11bb70978465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.302115 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daee52-3fd8-4dd2-a7b4-11bb70978465 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.302404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daee52-3fd8-4dd2-a7b4-11bb70978465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.302685 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daee52-3fd8-4dd2-a7b4-11bb70978465 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.303964 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daee52-3fd8-4dd2-a7b4-11bb70978465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:25:17.304269 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daee52-3fd8-4dd2-a7b4-11bb70978465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.304721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1120/2247] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:17.305952 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daee52-3fd8-4dd2-a7b4-11bb70978465 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:17.315857 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b7b5e-9f2c-4f88-b819-a80bd451b2b5 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.317729 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-b62b7b5e-9f2c-4f88-b819-a80bd451b2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:17.323860 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1128/2248] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:25:17.324929 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daee52-3fd8-4dd2-a7b4-11bb70978465 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.335058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daee52-3fd8-4dd2-a7b4-11bb70978465 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.339851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370448f-9328-45a0-8eba-0aa204281b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.340449 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370448f-9328-45a0-8eba-0aa204281b15 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.340735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370448f-9328-45a0-8eba-0aa204281b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.341016 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370448f-9328-45a0-8eba-0aa204281b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.341675 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370448f-9328-45a0-8eba-0aa204281b15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.343598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370448f-9328-45a0-8eba-0aa204281b15 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:17.345659 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:17.374634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1129/2249] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:25:17 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:25:17.378720 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370448f-9328-45a0-8eba-0aa204281b15 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.398710 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b7b5e-9f2c-4f88-b819-a80bd451b2b5 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.446508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370448f-9328-45a0-8eba-0aa204281b15 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.451186 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb362ca0-9ec5-4df2-93d8-43c5dd82dccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.451948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362ca0-9ec5-4df2-93d8-43c5dd82dccc admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.452228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362ca0-9ec5-4df2-93d8-43c5dd82dccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.452501 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb362ca0-9ec5-4df2-93d8-43c5dd82dccc admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.453157 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb362ca0-9ec5-4df2-93d8-43c5dd82dccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.455245 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb362ca0-9ec5-4df2-93d8-43c5dd82dccc admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:17.467566 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78080c-9bb3-450d-8430-ccbd3253b9e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93143507a8784a30bc6b4a5e1f24f0b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.468399 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78080c-9bb3-450d-8430-ccbd3253b9e3 service nova] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.468797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78080c-9bb3-450d-8430-ccbd3253b9e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.469214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78080c-9bb3-450d-8430-ccbd3253b9e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.477896 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1130/2250] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:25:17 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:17.481987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb362ca0-9ec5-4df2-93d8-43c5dd82dccc admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.491628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb362ca0-9ec5-4df2-93d8-43c5dd82dccc admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.496236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02188668-5dbd-4910-9e16-26845c58e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.496836 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02188668-5dbd-4910-9e16-26845c58e957 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.497116 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02188668-5dbd-4910-9e16-26845c58e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.497391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02188668-5dbd-4910-9e16-26845c58e957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.498121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02188668-5dbd-4910-9e16-26845c58e957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.499689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02188668-5dbd-4910-9e16-26845c58e957 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:17.509947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1131/2251] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:25:17.513462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02188668-5dbd-4910-9e16-26845c58e957 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.524601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02188668-5dbd-4910-9e16-26845c58e957 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.529137 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571fa08-129c-422c-b706-a977f4ceef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.529739 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571fa08-129c-422c-b706-a977f4ceef0e admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.530042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571fa08-129c-422c-b706-a977f4ceef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.530347 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571fa08-129c-422c-b706-a977f4ceef0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.531013 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571fa08-129c-422c-b706-a977f4ceef0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.532108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78080c-9bb3-450d-8430-ccbd3253b9e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.532584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571fa08-129c-422c-b706-a977f4ceef0e admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:17.533751 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78080c-9bb3-450d-8430-ccbd3253b9e3 service nova] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:17.543946 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1121/2252] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:25:17.551231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1132/2253] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:25:17.555456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78080c-9bb3-450d-8430-ccbd3253b9e3 service nova] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.574072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78080c-9bb3-450d-8430-ccbd3253b9e3 service nova] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.580823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b42e5f-580f-4637-9091-57da6d5bf174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.580823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b42e5f-580f-4637-9091-57da6d5bf174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.580823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b42e5f-580f-4637-9091-57da6d5bf174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.580823 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b42e5f-580f-4637-9091-57da6d5bf174 admin admin] PATH_INFO: `/v3/projects/84f98d445efa48eaa0599ed734ef0c47/users/553e6c84f36e49c7964a593a42122412/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.612972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b42e5f-580f-4637-9091-57da6d5bf174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f98d445efa48eaa0599ed734ef0c47, user_id=553e6c84f36e49c7964a593a42122412, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.615757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b42e5f-580f-4637-9091-57da6d5bf174 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:17.632453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1122/2254] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:17 2022] PUT /identity/v3/projects/84f98d445efa48eaa0599ed734ef0c47/users/553e6c84f36e49c7964a593a42122412/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:17.637685 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ad7ae-20ec-408f-b159-e5ed33a0ffb3 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.639268 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ad7ae-20ec-408f-b159-e5ed33a0ffb3 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.639268 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ad7ae-20ec-408f-b159-e5ed33a0ffb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.659247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-fe2ad7ae-20ec-408f-b159-e5ed33a0ffb3 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:17.660465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fe2ad7ae-20ec-408f-b159-e5ed33a0ffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:17.673689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:17.725783 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1133/2255] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:17.736171 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b42e5f-580f-4637-9091-57da6d5bf174 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.737971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e3b42e5f-580f-4637-9091-57da6d5bf174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:17.795212 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:17.836870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b42e5f-580f-4637-9091-57da6d5bf174 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.841463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d3df38-c4c6-4c37-b00a-f2a42d2c99bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.842210 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3df38-c4c6-4c37-b00a-f2a42d2c99bc service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.842584 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3df38-c4c6-4c37-b00a-f2a42d2c99bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.842868 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d3df38-c4c6-4c37-b00a-f2a42d2c99bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.853418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3df38-c4c6-4c37-b00a-f2a42d2c99bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.854874 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d3df38-c4c6-4c37-b00a-f2a42d2c99bc service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:17.864902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1123/2256] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:17.936101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ad7ae-20ec-408f-b159-e5ed33a0ffb3 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:17.947425 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ad7ae-20ec-408f-b159-e5ed33a0ffb3 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:17.952686 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:17.953465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:17.953908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:17.954225 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] PATH_INFO: `/v3/users/16f10d286d6e4233bafa05c05f00bb20` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:17.955455 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f10d286d6e4233bafa05c05f00bb20)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:17.958060 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:18.007276 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f10d286d6e4233bafa05c05f00bb20'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:18.015393 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f10d286d6e4233bafa05c05f00bb20'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:18.023626 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f10d286d6e4233bafa05c05f00bb20'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:18.024335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f10d286d6e4233bafa05c05f00bb20'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:18.038111 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f10d286d6e4233bafa05c05f00bb20'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:18.044654 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1134/2257] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:25:17 2022] DELETE /identity/v3/users/16f10d286d6e4233bafa05c05f00bb20 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:18.049781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ce7b3-a535-48a9-88e8-0fc96edd6d21 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:18.050099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ce7b3-a535-48a9-88e8-0fc96edd6d21 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:18.050381 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ce7b3-a535-48a9-88e8-0fc96edd6d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:18.070616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-256ce7b3-a535-48a9-88e8-0fc96edd6d21 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:18.072045 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-256ce7b3-a535-48a9-88e8-0fc96edd6d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:18.136218 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1124/2258] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:18.146607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:18.148542 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:18.224827 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797035-e6a7-46b0-ab61-2452f17fec8a admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:18.229243 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc25f4-3106-4478-bb0b-7e87926e4eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:18.230033 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc25f4-3106-4478-bb0b-7e87926e4eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:18.230398 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc25f4-3106-4478-bb0b-7e87926e4eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:18.231129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc25f4-3106-4478-bb0b-7e87926e4eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:18.247106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc25f4-3106-4478-bb0b-7e87926e4eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:18.249903 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc25f4-3106-4478-bb0b-7e87926e4eb4 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:18.271426 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1135/2259] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:18.671622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8fbae-f2f0-4477-9f44-3995d21efa92 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:18.672248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8fbae-f2f0-4477-9f44-3995d21efa92 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:18.672636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8fbae-f2f0-4477-9f44-3995d21efa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:18.704489 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6fd8fbae-f2f0-4477-9f44-3995d21efa92 None None] MFA Rules not processed for user `553e6c84f36e49c7964a593a42122412`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:18.705933 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6fd8fbae-f2f0-4477-9f44-3995d21efa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:18.744112 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc25f4-3106-4478-bb0b-7e87926e4eb4 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:18.745880 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-f8dc25f4-3106-4478-bb0b-7e87926e4eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:18.762234 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc25f4-3106-4478-bb0b-7e87926e4eb4 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:18.770406 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:18.771351 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:18.777983 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:18.778244 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] PATH_INFO: `/v3/projects/75a82e981d0e4bcd81bfca9ed544f62d` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:18.782310 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a82e981d0e4bcd81bfca9ed544f62d)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:18.785050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:18.792645 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1125/2260] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:18.804316 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8fbae-f2f0-4477-9f44-3995d21efa92 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:18.805920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6fd8fbae-f2f0-4477-9f44-3995d21efa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:18.830597 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:18.875635 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a82e981d0e4bcd81bfca9ed544f62d', 'request_id': 'req-b3416981-c799-475a-8f6d-9a2e9a113354'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:18.886575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a82e981d0e4bcd81bfca9ed544f62d', 'request_id': 'req-b3416981-c799-475a-8f6d-9a2e9a113354'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:18.899210 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a82e981d0e4bcd81bfca9ed544f62d', 'request_id': 'req-b3416981-c799-475a-8f6d-9a2e9a113354'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:18.923535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8fbae-f2f0-4477-9f44-3995d21efa92 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:18.929535 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] The token cache is being invalidate because project 75a82e981d0e4bcd81bfca9ed544f62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:25:18.929535 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:18.931812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b3416981-c799-475a-8f6d-9a2e9a113354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:18.937101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1136/2261] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:25:18 2022] DELETE /identity/v3/projects/75a82e981d0e4bcd81bfca9ed544f62d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:25:18.939221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdb6f1-67fa-4cd8-9c7b-bfa85c04db21 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:18.939724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdb6f1-67fa-4cd8-9c7b-bfa85c04db21 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:18.940127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdb6f1-67fa-4cd8-9c7b-bfa85c04db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:18.946706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=100 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:18.967514 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-4abdb6f1-67fa-4cd8-9c7b-bfa85c04db21 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:18.969195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-4abdb6f1-67fa-4cd8-9c7b-bfa85c04db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:18.990835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb74b5a-8b0d-4998-9366-743d346100b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:18.991471 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb74b5a-8b0d-4998-9366-743d346100b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:18.991755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb74b5a-8b0d-4998-9366-743d346100b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:18.992034 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb74b5a-8b0d-4998-9366-743d346100b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:18.993872 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-beb74b5a-8b0d-4998-9366-743d346100b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:19.068121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1137/2262] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:19.077191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29375601-aff6-42d8-bd5e-2ce8626729b2 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.077611 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29375601-aff6-42d8-bd5e-2ce8626729b2 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.078035 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29375601-aff6-42d8-bd5e-2ce8626729b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.107930 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb74b5a-8b0d-4998-9366-743d346100b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:19.109657 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb74b5a-8b0d-4998-9366-743d346100b1 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:19.118719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-29375601-aff6-42d8-bd5e-2ce8626729b2 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:19.120360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1126/2263] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 08:25:19.120719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-29375601-aff6-42d8-bd5e-2ce8626729b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:19.132124 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1138/2264] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:19.139200 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb74b5a-8b0d-4998-9366-743d346100b1 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:19.150614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb74b5a-8b0d-4998-9366-743d346100b1 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:19.155803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d6f40-6627-45f9-9fc4-3ba30a25b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:19.156596 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d6f40-6627-45f9-9fc4-3ba30a25b53b admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.156963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d6f40-6627-45f9-9fc4-3ba30a25b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.157339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d6f40-6627-45f9-9fc4-3ba30a25b53b admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.158173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d6f40-6627-45f9-9fc4-3ba30a25b53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:25:19.158594 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d6f40-6627-45f9-9fc4-3ba30a25b53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:19.160586 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d6f40-6627-45f9-9fc4-3ba30a25b53b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:19.174708 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1127/2265] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:25:19.179765 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29375601-aff6-42d8-bd5e-2ce8626729b2 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:19.190190 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29375601-aff6-42d8-bd5e-2ce8626729b2 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:19.196206 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cfcda-eef4-42da-85f8-43bf42d0ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:19.197948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cfcda-eef4-42da-85f8-43bf42d0ad5c admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.197948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cfcda-eef4-42da-85f8-43bf42d0ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.197948 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cfcda-eef4-42da-85f8-43bf42d0ad5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.198468 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cfcda-eef4-42da-85f8-43bf42d0ad5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:19.200717 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cfcda-eef4-42da-85f8-43bf42d0ad5c admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:19.237491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1139/2266] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:25:19 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:19.239333 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d6f40-6627-45f9-9fc4-3ba30a25b53b admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:19.252437 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d6f40-6627-45f9-9fc4-3ba30a25b53b admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:19.338150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f31f02-9a6f-4aed-9f00-4aa8fa98e1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:19.338870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f31f02-9a6f-4aed-9f00-4aa8fa98e1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.339267 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f31f02-9a6f-4aed-9f00-4aa8fa98e1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.339571 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f31f02-9a6f-4aed-9f00-4aa8fa98e1f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.340313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f31f02-9a6f-4aed-9f00-4aa8fa98e1f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:19.342473 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f31f02-9a6f-4aed-9f00-4aa8fa98e1f0 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:19.379962 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1128/2267] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:25:19 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:19.384224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cfcda-eef4-42da-85f8-43bf42d0ad5c admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:19.400132 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cfcda-eef4-42da-85f8-43bf42d0ad5c admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:19.405969 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf06c3d-a8b6-4167-8335-da411e866a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:19.406721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf06c3d-a8b6-4167-8335-da411e866a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.407215 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf06c3d-a8b6-4167-8335-da411e866a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.407624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf06c3d-a8b6-4167-8335-da411e866a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.408416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf06c3d-a8b6-4167-8335-da411e866a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:19.410153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf06c3d-a8b6-4167-8335-da411e866a25 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:19.422054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1140/2268] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:19.426354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f31f02-9a6f-4aed-9f00-4aa8fa98e1f0 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:19.451529 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f31f02-9a6f-4aed-9f00-4aa8fa98e1f0 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:19.458991 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de55a36-1a9c-48c4-8f02-8c09afc296e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:19.459806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55a36-1a9c-48c4-8f02-8c09afc296e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.460185 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55a36-1a9c-48c4-8f02-8c09afc296e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.460553 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de55a36-1a9c-48c4-8f02-8c09afc296e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.461684 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55a36-1a9c-48c4-8f02-8c09afc296e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:19.464225 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de55a36-1a9c-48c4-8f02-8c09afc296e1 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:19.483201 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1129/2269] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:25:19.487663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf06c3d-a8b6-4167-8335-da411e866a25 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:19.512622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf06c3d-a8b6-4167-8335-da411e866a25 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:19.519748 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c720d-c98e-44a1-a0b3-3c59c23f6499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:19.520573 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c720d-c98e-44a1-a0b3-3c59c23f6499 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.520963 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c720d-c98e-44a1-a0b3-3c59c23f6499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.521345 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c720d-c98e-44a1-a0b3-3c59c23f6499 admin admin] PATH_INFO: `/v3/projects/bf7b7e0ae7ac46d786d59326511c636a/users/c35cd4b2b04041d0980681a4f2c07cb1/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.538971 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c720d-c98e-44a1-a0b3-3c59c23f6499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7b7e0ae7ac46d786d59326511c636a, user_id=c35cd4b2b04041d0980681a4f2c07cb1, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:19.542139 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c720d-c98e-44a1-a0b3-3c59c23f6499 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:19.559009 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1141/2270] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:19 2022] PUT /identity/v3/projects/bf7b7e0ae7ac46d786d59326511c636a/users/c35cd4b2b04041d0980681a4f2c07cb1/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:19.571085 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589da0f-1d46-49ab-ab81-b7d85a43ccc4 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.571382 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589da0f-1d46-49ab-ab81-b7d85a43ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.572600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589da0f-1d46-49ab-ab81-b7d85a43ccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.604684 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-c589da0f-1d46-49ab-ab81-b7d85a43ccc4 None None] MFA Rules not processed for user `c35cd4b2b04041d0980681a4f2c07cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:19.606891 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c589da0f-1d46-49ab-ab81-b7d85a43ccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:19.647624 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:19.684501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1130/2271] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:19.689022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c720d-c98e-44a1-a0b3-3c59c23f6499 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:19.744311 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:19.756600 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c720d-c98e-44a1-a0b3-3c59c23f6499 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:19.761916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8bd97-d373-48d1-8bb9-76e18383e313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:19.762571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8bd97-d373-48d1-8bb9-76e18383e313 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.762851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8bd97-d373-48d1-8bb9-76e18383e313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.763128 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8bd97-d373-48d1-8bb9-76e18383e313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.764087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8bd97-d373-48d1-8bb9-76e18383e313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:19.765975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8bd97-d373-48d1-8bb9-76e18383e313 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:19.791608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1142/2272] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:25:19 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:25:19.795927 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589da0f-1d46-49ab-ab81-b7d85a43ccc4 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:19.807132 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589da0f-1d46-49ab-ab81-b7d85a43ccc4 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:19.864886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3d96d-ac9b-49fd-bb38-737ecb2b4400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:19.865521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3d96d-ac9b-49fd-bb38-737ecb2b4400 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.865806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3d96d-ac9b-49fd-bb38-737ecb2b4400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.866110 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3d96d-ac9b-49fd-bb38-737ecb2b4400 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.866793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3d96d-ac9b-49fd-bb38-737ecb2b4400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:19.868732 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3d96d-ac9b-49fd-bb38-737ecb2b4400 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:19.891774 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1131/2273] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:25:19 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:25:19.895795 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8bd97-d373-48d1-8bb9-76e18383e313 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:19.906848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8bd97-d373-48d1-8bb9-76e18383e313 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:19.911503 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bcd4a-8a8c-41e3-87ad-46eb8d135f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:19.912848 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bcd4a-8a8c-41e3-87ad-46eb8d135f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.913134 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bcd4a-8a8c-41e3-87ad-46eb8d135f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.913412 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bcd4a-8a8c-41e3-87ad-46eb8d135f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.914144 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bcd4a-8a8c-41e3-87ad-46eb8d135f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:19.915735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bcd4a-8a8c-41e3-87ad-46eb8d135f11 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:19.926540 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1143/2274] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:19.930768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3d96d-ac9b-49fd-bb38-737ecb2b4400 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:19.940565 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3d96d-ac9b-49fd-bb38-737ecb2b4400 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:19.945150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d2217-00a9-433c-ab2f-aea7988b32d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:19.945803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d2217-00a9-433c-ab2f-aea7988b32d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:19.946124 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d2217-00a9-433c-ab2f-aea7988b32d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:19.946402 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d2217-00a9-433c-ab2f-aea7988b32d3 admin admin] PATH_INFO: `/v3/projects/3b6858720af64e5d84bdd6d51eb17325/users/56534946fc2040c7ade73163ad5bcb2b/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:19.963056 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d2217-00a9-433c-ab2f-aea7988b32d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6858720af64e5d84bdd6d51eb17325, user_id=56534946fc2040c7ade73163ad5bcb2b, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:19.965704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d2217-00a9-433c-ab2f-aea7988b32d3 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:19.980343 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1132/2275] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:19 2022] PUT /identity/v3/projects/3b6858720af64e5d84bdd6d51eb17325/users/56534946fc2040c7ade73163ad5bcb2b/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:19.984523 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bcd4a-8a8c-41e3-87ad-46eb8d135f11 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:19.995152 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bcd4a-8a8c-41e3-87ad-46eb8d135f11 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:20.056424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ca9bc-943f-4727-89c5-0019cc2b34ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:20.057041 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ca9bc-943f-4727-89c5-0019cc2b34ef admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:20.057321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ca9bc-943f-4727-89c5-0019cc2b34ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:20.057594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ca9bc-943f-4727-89c5-0019cc2b34ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:20.058320 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ca9bc-943f-4727-89c5-0019cc2b34ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:20.059904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ca9bc-943f-4727-89c5-0019cc2b34ef admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:20.071536 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1144/2276] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:20.076596 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d2217-00a9-433c-ab2f-aea7988b32d3 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:20.088288 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d2217-00a9-433c-ab2f-aea7988b32d3 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:20.094653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38001d8-7968-4a02-9add-c7dc3145fe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:20.095394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38001d8-7968-4a02-9add-c7dc3145fe58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:20.095740 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38001d8-7968-4a02-9add-c7dc3145fe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:20.096024 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38001d8-7968-4a02-9add-c7dc3145fe58 admin admin] PATH_INFO: `/v3/projects/3b6858720af64e5d84bdd6d51eb17325/users/56534946fc2040c7ade73163ad5bcb2b/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:20.098173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38001d8-7968-4a02-9add-c7dc3145fe58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6858720af64e5d84bdd6d51eb17325, user_id=56534946fc2040c7ade73163ad5bcb2b, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:20.102095 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38001d8-7968-4a02-9add-c7dc3145fe58 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:20.116849 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1133/2277] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:20 2022] PUT /identity/v3/projects/3b6858720af64e5d84bdd6d51eb17325/users/56534946fc2040c7ade73163ad5bcb2b/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:20.128485 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9026-f4e6-46f5-b833-e0971c1b5250 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:20.129168 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9026-f4e6-46f5-b833-e0971c1b5250 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:20.129168 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9026-f4e6-46f5-b833-e0971c1b5250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:20.161541 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-3eff9026-f4e6-46f5-b833-e0971c1b5250 None None] MFA Rules not processed for user `56534946fc2040c7ade73163ad5bcb2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:20.163619 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-3eff9026-f4e6-46f5-b833-e0971c1b5250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:20.249843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1145/2278] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:20.268763 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38001d8-7968-4a02-9add-c7dc3145fe58 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:20.270609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e38001d8-7968-4a02-9add-c7dc3145fe58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:20.335283 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38001d8-7968-4a02-9add-c7dc3145fe58 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:20.339494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6d723-f98d-430b-b724-d184b4432bda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:20.340127 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6d723-f98d-430b-b724-d184b4432bda service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:20.340403 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6d723-f98d-430b-b724-d184b4432bda service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:20.340767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6d723-f98d-430b-b724-d184b4432bda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:20.350826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6d723-f98d-430b-b724-d184b4432bda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:20.352238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6d723-f98d-430b-b724-d184b4432bda service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:20.362885 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1134/2279] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:20.570551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4cf5f-74b2-4696-8be4-062c73c93975 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:20.571827 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4cf5f-74b2-4696-8be4-062c73c93975 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:20.572107 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4cf5f-74b2-4696-8be4-062c73c93975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:20.591273 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-afb4cf5f-74b2-4696-8be4-062c73c93975 None None] MFA Rules not processed for user `553e6c84f36e49c7964a593a42122412`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:20.592462 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-afb4cf5f-74b2-4696-8be4-062c73c93975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:20.645667 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:20.661037 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1146/2280] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:20.806643 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6d723-f98d-430b-b724-d184b4432bda service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:20.851420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:20.901122 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6d723-f98d-430b-b724-d184b4432bda service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:20.911155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:20.912494 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:20.912943 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:20.913297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] PATH_INFO: `/v3/users/c35cd4b2b04041d0980681a4f2c07cb1` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:20.914706 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35cd4b2b04041d0980681a4f2c07cb1)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:20.916699 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:20.972422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35cd4b2b04041d0980681a4f2c07cb1'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:20.972422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35cd4b2b04041d0980681a4f2c07cb1'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:20.983412 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35cd4b2b04041d0980681a4f2c07cb1'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.000648 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35cd4b2b04041d0980681a4f2c07cb1'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.001636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35cd4b2b04041d0980681a4f2c07cb1'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.016169 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1135/2281] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:25:20 2022] DELETE /identity/v3/users/c35cd4b2b04041d0980681a4f2c07cb1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:21.030608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feebfbc-98d8-410a-b26d-825ca0106e83 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:21.031181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feebfbc-98d8-410a-b26d-825ca0106e83 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:21.031181 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feebfbc-98d8-410a-b26d-825ca0106e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:21.051483 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-5feebfbc-98d8-410a-b26d-825ca0106e83 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:21.053278 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5feebfbc-98d8-410a-b26d-825ca0106e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:21.127612 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1147/2282] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:21.137882 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:21.140327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:21.213340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdb1fa-2e3a-41df-80a9-0b359248ef49 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:21.218224 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85bb03-0180-4fdf-aef6-627cabd9c55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:21.219072 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85bb03-0180-4fdf-aef6-627cabd9c55c service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:21.219484 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85bb03-0180-4fdf-aef6-627cabd9c55c service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:21.219965 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85bb03-0180-4fdf-aef6-627cabd9c55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:21.234329 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85bb03-0180-4fdf-aef6-627cabd9c55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:21.238001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85bb03-0180-4fdf-aef6-627cabd9c55c service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:21.250632 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1136/2283] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:21.344660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feebfbc-98d8-410a-b26d-825ca0106e83 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:21.346463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-5feebfbc-98d8-410a-b26d-825ca0106e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:21.375480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feebfbc-98d8-410a-b26d-825ca0106e83 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:21.389954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:21.390658 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:21.390942 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:21.391221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] PATH_INFO: `/v3/users/a3f09fb52b0843229a0ea401c3f2ef45` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:21.393256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f09fb52b0843229a0ea401c3f2ef45)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:21.395279 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:21.500459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f09fb52b0843229a0ea401c3f2ef45'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.512465 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f09fb52b0843229a0ea401c3f2ef45'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.538678 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f09fb52b0843229a0ea401c3f2ef45'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.539875 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f09fb52b0843229a0ea401c3f2ef45'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.570463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f09fb52b0843229a0ea401c3f2ef45'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.580987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1148/2284] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:25:21 2022] DELETE /identity/v3/users/a3f09fb52b0843229a0ea401c3f2ef45 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:21.586060 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559631da-8239-49f0-bc40-1b3877637c30 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:21.586564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559631da-8239-49f0-bc40-1b3877637c30 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:21.586988 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559631da-8239-49f0-bc40-1b3877637c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:21.612233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-559631da-8239-49f0-bc40-1b3877637c30 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:21.613781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-559631da-8239-49f0-bc40-1b3877637c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:21.684244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:21.708234 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1137/2285] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:21.720093 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:21.721840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:21.763264 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559631da-8239-49f0-bc40-1b3877637c30 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:21.764972 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-559631da-8239-49f0-bc40-1b3877637c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:21.784427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559631da-8239-49f0-bc40-1b3877637c30 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:21.801102 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:21.803340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:21.803837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:21.805319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] PATH_INFO: `/v3/projects/bf7b7e0ae7ac46d786d59326511c636a` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:21.808454 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7b7e0ae7ac46d786d59326511c636a)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:21.812780 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:21.822460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72668fec-b1a5-44b5-94ec-bdaec476392d admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:21.826605 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5480-5907-40de-bba2-ee46ef708802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:21.827256 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5480-5907-40de-bba2-ee46ef708802 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:21.828158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5480-5907-40de-bba2-ee46ef708802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:21.828504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5480-5907-40de-bba2-ee46ef708802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:21.845318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac5480-5907-40de-bba2-ee46ef708802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:21.847391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac5480-5907-40de-bba2-ee46ef708802 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:21.860760 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1149/2286] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:21.872803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7b7e0ae7ac46d786d59326511c636a', 'request_id': 'req-602f6cec-bae1-4cff-b05b-3508cbdae27d'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.879682 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7b7e0ae7ac46d786d59326511c636a', 'request_id': 'req-602f6cec-bae1-4cff-b05b-3508cbdae27d'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.886315 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7b7e0ae7ac46d786d59326511c636a', 'request_id': 'req-602f6cec-bae1-4cff-b05b-3508cbdae27d'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.899588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] The token cache is being invalidate because project bf7b7e0ae7ac46d786d59326511c636a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:25:21.899886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.900827 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:21.902953 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1138/2287] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:25:21 2022] DELETE /identity/v3/projects/bf7b7e0ae7ac46d786d59326511c636a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:25:21.907281 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5480-5907-40de-bba2-ee46ef708802 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:21.918271 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5480-5907-40de-bba2-ee46ef708802 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:21.923377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:21.986941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:21.987691 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:21.988043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:21.988392 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] PATH_INFO: `/v3/users/56534946fc2040c7ade73163ad5bcb2b` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:21.989681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56534946fc2040c7ade73163ad5bcb2b)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:21.991758 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:22.050606 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56534946fc2040c7ade73163ad5bcb2b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.059722 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56534946fc2040c7ade73163ad5bcb2b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.067882 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56534946fc2040c7ade73163ad5bcb2b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.068907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56534946fc2040c7ade73163ad5bcb2b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.089795 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56534946fc2040c7ade73163ad5bcb2b'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.102379 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1150/2288] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:25:21 2022] DELETE /identity/v3/users/56534946fc2040c7ade73163ad5bcb2b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:22.218319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:22.219776 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:22.252532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f6cec-bae1-4cff-b05b-3508cbdae27d admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:22.337265 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:22.338346 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:22.338714 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:22.339035 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] PATH_INFO: `/v3/projects/ef5a23922ef54bd7b5e7b48f737c9654` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:22.340228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5a23922ef54bd7b5e7b48f737c9654)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:22.342172 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:22.398420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5a23922ef54bd7b5e7b48f737c9654', 'request_id': 'req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.404589 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5a23922ef54bd7b5e7b48f737c9654', 'request_id': 'req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.411133 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5a23922ef54bd7b5e7b48f737c9654', 'request_id': 'req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.423733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] The token cache is being invalidate because project ef5a23922ef54bd7b5e7b48f737c9654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:25:22.424023 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.424681 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-a7fbd1ce-d76a-4115-91a0-8e70295b5a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.426462 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1139/2289] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:25:22 2022] DELETE /identity/v3/projects/ef5a23922ef54bd7b5e7b48f737c9654 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:22.467747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:22.469798 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:22.514277 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e519-1b2e-4da2-a71d-c95c7e57f202 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:22.592230 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:22.593260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:22.593745 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:22.594231 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] PATH_INFO: `/v3/projects/3b6858720af64e5d84bdd6d51eb17325` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:22.598435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6858720af64e5d84bdd6d51eb17325)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:22.598435 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:22.647949 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:22.663042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6858720af64e5d84bdd6d51eb17325', 'request_id': 'req-545214a3-e5a3-4439-b39e-94687ddfdcf9'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.669266 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6858720af64e5d84bdd6d51eb17325', 'request_id': 'req-545214a3-e5a3-4439-b39e-94687ddfdcf9'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.675698 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6858720af64e5d84bdd6d51eb17325', 'request_id': 'req-545214a3-e5a3-4439-b39e-94687ddfdcf9'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.692134 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] The token cache is being invalidate because project 3b6858720af64e5d84bdd6d51eb17325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:25:22.692432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.693806 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-545214a3-e5a3-4439-b39e-94687ddfdcf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:25:22.695975 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1151/2290] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:25:22 2022] DELETE /identity/v3/projects/3b6858720af64e5d84bdd6d51eb17325 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:22.700488 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7075bb2-cca9-428a-bed3-8ea0484e20c7 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:22.701066 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7075bb2-cca9-428a-bed3-8ea0484e20c7 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:22.701549 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7075bb2-cca9-428a-bed3-8ea0484e20c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:22.711305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:22.736474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-e7075bb2-cca9-428a-bed3-8ea0484e20c7 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:22.738257 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e7075bb2-cca9-428a-bed3-8ea0484e20c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:22.824876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1140/2291] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:22.832797 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f07b9-cf4e-461f-aeff-4c15d032ba5d None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:22.833089 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f07b9-cf4e-461f-aeff-4c15d032ba5d None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:22.833366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f07b9-cf4e-461f-aeff-4c15d032ba5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:22.858077 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-2b6f07b9-cf4e-461f-aeff-4c15d032ba5d None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:22.859376 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-2b6f07b9-cf4e-461f-aeff-4c15d032ba5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:22.870138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1152/2292] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:22.874528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7075bb2-cca9-428a-bed3-8ea0484e20c7 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:22.884957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7075bb2-cca9-428a-bed3-8ea0484e20c7 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:22.890580 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15086587-df5a-4d24-9184-6616d1790b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:22.891218 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086587-df5a-4d24-9184-6616d1790b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:22.891521 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086587-df5a-4d24-9184-6616d1790b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:22.891916 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15086587-df5a-4d24-9184-6616d1790b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:22.892660 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15086587-df5a-4d24-9184-6616d1790b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:25:22.893100 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15086587-df5a-4d24-9184-6616d1790b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:22.894923 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15086587-df5a-4d24-9184-6616d1790b7d admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:22.907880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1141/2293] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 08:25:22.912276 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f07b9-cf4e-461f-aeff-4c15d032ba5d None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:22.921488 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f07b9-cf4e-461f-aeff-4c15d032ba5d None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:22.926081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00d679-c685-4be2-af7f-52a448b70638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:22.926683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00d679-c685-4be2-af7f-52a448b70638 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:22.926958 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00d679-c685-4be2-af7f-52a448b70638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:22.927228 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00d679-c685-4be2-af7f-52a448b70638 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:22.928579 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00d679-c685-4be2-af7f-52a448b70638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:22.930509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00d679-c685-4be2-af7f-52a448b70638 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:22.959602 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1153/2294] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:25:22 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:22.963802 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15086587-df5a-4d24-9184-6616d1790b7d admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:22.973837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15086587-df5a-4d24-9184-6616d1790b7d admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:23.031282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e34f0-6d47-439b-93b2-225eb802a814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:23.031897 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e34f0-6d47-439b-93b2-225eb802a814 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.032174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e34f0-6d47-439b-93b2-225eb802a814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.032447 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e34f0-6d47-439b-93b2-225eb802a814 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.033113 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e34f0-6d47-439b-93b2-225eb802a814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:23.035069 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e34f0-6d47-439b-93b2-225eb802a814 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:23.057839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1142/2295] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:25:22 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:25:23.062108 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00d679-c685-4be2-af7f-52a448b70638 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:23.073250 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00d679-c685-4be2-af7f-52a448b70638 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:23.077784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a26a2-7a93-428d-b125-99ff66cb43a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:23.078419 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a26a2-7a93-428d-b125-99ff66cb43a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.078700 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a26a2-7a93-428d-b125-99ff66cb43a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.078974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a26a2-7a93-428d-b125-99ff66cb43a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.079695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a26a2-7a93-428d-b125-99ff66cb43a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:23.081274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a26a2-7a93-428d-b125-99ff66cb43a5 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:23.092067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1154/2296] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:23.096323 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e34f0-6d47-439b-93b2-225eb802a814 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:23.107030 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e34f0-6d47-439b-93b2-225eb802a814 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:23.111820 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799947c0-49c1-4810-90c1-f780f161a50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:23.112420 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799947c0-49c1-4810-90c1-f780f161a50a admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.112702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799947c0-49c1-4810-90c1-f780f161a50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.112973 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799947c0-49c1-4810-90c1-f780f161a50a admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.113663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799947c0-49c1-4810-90c1-f780f161a50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:23.115969 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799947c0-49c1-4810-90c1-f780f161a50a admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:23.126500 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1143/2297] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:23.130877 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a26a2-7a93-428d-b125-99ff66cb43a5 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:23.141852 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a26a2-7a93-428d-b125-99ff66cb43a5 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:23.147045 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbda01-68c1-4781-a3bb-e541f29b5e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:23.147751 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbda01-68c1-4781-a3bb-e541f29b5e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.148035 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbda01-68c1-4781-a3bb-e541f29b5e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.148312 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbda01-68c1-4781-a3bb-e541f29b5e52 admin admin] PATH_INFO: `/v3/projects/dbda3c76626a455faa1a8e115d850155/users/46aa96ec379342b9bb1c754e9a66fff7/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.164094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbda01-68c1-4781-a3bb-e541f29b5e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbda3c76626a455faa1a8e115d850155, user_id=46aa96ec379342b9bb1c754e9a66fff7, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:23.166805 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbda01-68c1-4781-a3bb-e541f29b5e52 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:23.180241 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1155/2298] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:23 2022] PUT /identity/v3/projects/dbda3c76626a455faa1a8e115d850155/users/46aa96ec379342b9bb1c754e9a66fff7/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:23.190456 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2b66e-6379-418d-b185-0282692d230d None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.190770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2b66e-6379-418d-b185-0282692d230d None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.191051 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2b66e-6379-418d-b185-0282692d230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.218282 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-aaa2b66e-6379-418d-b185-0282692d230d None None] MFA Rules not processed for user `46aa96ec379342b9bb1c754e9a66fff7`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:23.219480 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-aaa2b66e-6379-418d-b185-0282692d230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:23.280411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:23.288229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1144/2299] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:25:23.292872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbda01-68c1-4781-a3bb-e541f29b5e52 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:23.377052 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbda01-68c1-4781-a3bb-e541f29b5e52 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:23.382452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738223d1-fa4f-476c-a38e-aa879af69dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:23.383377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738223d1-fa4f-476c-a38e-aa879af69dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.383814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738223d1-fa4f-476c-a38e-aa879af69dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.384200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738223d1-fa4f-476c-a38e-aa879af69dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.385058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738223d1-fa4f-476c-a38e-aa879af69dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:23.389657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738223d1-fa4f-476c-a38e-aa879af69dc9 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:23.422982 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1156/2300] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:25:23 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:23.426545 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2b66e-6379-418d-b185-0282692d230d None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:23.439455 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2b66e-6379-418d-b185-0282692d230d None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:23.510902 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ff4e2-7057-4525-ba7c-fdfff3796175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:23.511466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ff4e2-7057-4525-ba7c-fdfff3796175 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.511801 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ff4e2-7057-4525-ba7c-fdfff3796175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.512082 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ff4e2-7057-4525-ba7c-fdfff3796175 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.512835 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ff4e2-7057-4525-ba7c-fdfff3796175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:23.515354 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ff4e2-7057-4525-ba7c-fdfff3796175 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:23.545154 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1145/2301] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:25:23 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:25:23.546463 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738223d1-fa4f-476c-a38e-aa879af69dc9 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:23.557741 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738223d1-fa4f-476c-a38e-aa879af69dc9 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:23.565201 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c91ae-aebf-47df-b6ee-ef3e90c3c5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:23.566148 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c91ae-aebf-47df-b6ee-ef3e90c3c5bc admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.566705 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c91ae-aebf-47df-b6ee-ef3e90c3c5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.567699 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c91ae-aebf-47df-b6ee-ef3e90c3c5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.568004 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c91ae-aebf-47df-b6ee-ef3e90c3c5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:23.570622 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54c91ae-aebf-47df-b6ee-ef3e90c3c5bc admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:23.585598 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1157/2302] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:23.589772 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ff4e2-7057-4525-ba7c-fdfff3796175 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:23.601837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ff4e2-7057-4525-ba7c-fdfff3796175 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:23.607106 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603fbf4-8f8c-4d4e-9719-9331a77071ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:23.607837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603fbf4-8f8c-4d4e-9719-9331a77071ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.608121 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603fbf4-8f8c-4d4e-9719-9331a77071ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.608389 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603fbf4-8f8c-4d4e-9719-9331a77071ba admin admin] PATH_INFO: `/v3/projects/9d6f1a68427245c881c2772e5686698b/users/e9ddd6dbd30742d2855fff3a499e552e/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.624869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603fbf4-8f8c-4d4e-9719-9331a77071ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6f1a68427245c881c2772e5686698b, user_id=e9ddd6dbd30742d2855fff3a499e552e, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:23.627486 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603fbf4-8f8c-4d4e-9719-9331a77071ba admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:23.645186 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1146/2303] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:23 2022] PUT /identity/v3/projects/9d6f1a68427245c881c2772e5686698b/users/e9ddd6dbd30742d2855fff3a499e552e/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:23.649486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c91ae-aebf-47df-b6ee-ef3e90c3c5bc admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:23.667249 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c91ae-aebf-47df-b6ee-ef3e90c3c5bc admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:23.698121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:23.735617 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b54896-173b-4434-9439-8c4f254a37a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:23.736237 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b54896-173b-4434-9439-8c4f254a37a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.736516 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b54896-173b-4434-9439-8c4f254a37a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.736788 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b54896-173b-4434-9439-8c4f254a37a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.737495 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b54896-173b-4434-9439-8c4f254a37a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:23.739099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b54896-173b-4434-9439-8c4f254a37a4 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:23.749121 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1158/2304] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:25:23.753313 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603fbf4-8f8c-4d4e-9719-9331a77071ba admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:23.764108 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603fbf4-8f8c-4d4e-9719-9331a77071ba admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:23.770261 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b996dd4-4dc3-4759-ac86-eee7f352fde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:23.771887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b996dd4-4dc3-4759-ac86-eee7f352fde9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.772266 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b996dd4-4dc3-4759-ac86-eee7f352fde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.772550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b996dd4-4dc3-4759-ac86-eee7f352fde9 admin admin] PATH_INFO: `/v3/projects/9d6f1a68427245c881c2772e5686698b/users/e9ddd6dbd30742d2855fff3a499e552e/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.775155 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b996dd4-4dc3-4759-ac86-eee7f352fde9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6f1a68427245c881c2772e5686698b, user_id=e9ddd6dbd30742d2855fff3a499e552e, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:23.778525 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b996dd4-4dc3-4759-ac86-eee7f352fde9 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:23.790183 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1147/2305] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:25:23 2022] PUT /identity/v3/projects/9d6f1a68427245c881c2772e5686698b/users/e9ddd6dbd30742d2855fff3a499e552e/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:25:23.801552 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31bce1-1a57-4d9c-af58-ebf9ebe34d30 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:23.801947 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31bce1-1a57-4d9c-af58-ebf9ebe34d30 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:23.802308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31bce1-1a57-4d9c-af58-ebf9ebe34d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:23.832223 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-fd31bce1-1a57-4d9c-af58-ebf9ebe34d30 None None] MFA Rules not processed for user `e9ddd6dbd30742d2855fff3a499e552e`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:23.833448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-fd31bce1-1a57-4d9c-af58-ebf9ebe34d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:23.926667 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1159/2306] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:25:23.938293 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b996dd4-4dc3-4759-ac86-eee7f352fde9 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:23.945793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7b996dd4-4dc3-4759-ac86-eee7f352fde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:24.020348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b996dd4-4dc3-4759-ac86-eee7f352fde9 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:24.024915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3c629-3149-4a47-b57a-7482a581d93b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:24.025790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3c629-3149-4a47-b57a-7482a581d93b service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:24.026296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3c629-3149-4a47-b57a-7482a581d93b service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:24.026662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3c629-3149-4a47-b57a-7482a581d93b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:24.120092 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3c629-3149-4a47-b57a-7482a581d93b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:24.121563 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3c629-3149-4a47-b57a-7482a581d93b service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:24.131325 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1148/2307] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:33.922563 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=50 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:34.016925 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31bce1-1a57-4d9c-af58-ebf9ebe34d30 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:25:34.028628 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31bce1-1a57-4d9c-af58-ebf9ebe34d30 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:25:34.032200 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7693c-c4bb-4af5-985e-7cb296dd15bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:25:34.032826 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7693c-c4bb-4af5-985e-7cb296dd15bd service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:34.033103 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7693c-c4bb-4af5-985e-7cb296dd15bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:34.033374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7693c-c4bb-4af5-985e-7cb296dd15bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:34.043248 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7693c-c4bb-4af5-985e-7cb296dd15bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:25:34.044690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b7693c-c4bb-4af5-985e-7cb296dd15bd service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:25:34.054101 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1160/2308] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:25:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:25:34.126537 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:44.049884 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=6 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:25:53.376651 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29086-2509-4018-b86f-4471b6313a8f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:25:53.377253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29086-2509-4018-b86f-4471b6313a8f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:25:53.377253 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d29086-2509-4018-b86f-4471b6313a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:25:53.396600 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-e8d29086-2509-4018-b86f-4471b6313a8f None None] MFA Rules not processed for user `dc97bab8d9c943ee968db907513cc0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:25:53.397836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e8d29086-2509-4018-b86f-4471b6313a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:25:53.454792 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1149/2309] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:25:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:03.448911 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=25 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:10.471039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7693c-c4bb-4af5-985e-7cb296dd15bd service cinder] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:10.539179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b7693c-c4bb-4af5-985e-7cb296dd15bd service cinder] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:10.544201 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:10.544851 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:10.545135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:10.545416 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] PATH_INFO: `/v3/users/46aa96ec379342b9bb1c754e9a66fff7` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:10.546618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=46aa96ec379342b9bb1c754e9a66fff7)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:10.548580 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:10.606825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46aa96ec379342b9bb1c754e9a66fff7'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:10.617006 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46aa96ec379342b9bb1c754e9a66fff7'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:10.628150 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46aa96ec379342b9bb1c754e9a66fff7'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:10.628795 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46aa96ec379342b9bb1c754e9a66fff7'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:10.647509 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46aa96ec379342b9bb1c754e9a66fff7'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:10.653906 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1161/2310] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:26:10 2022] DELETE /identity/v3/users/46aa96ec379342b9bb1c754e9a66fff7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:10.658579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67dccf-cc94-4ca1-b06a-2f6989410eec None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:10.659078 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67dccf-cc94-4ca1-b06a-2f6989410eec None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:10.659172 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67dccf-cc94-4ca1-b06a-2f6989410eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:10.678842 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6b67dccf-cc94-4ca1-b06a-2f6989410eec None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:10.680068 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6b67dccf-cc94-4ca1-b06a-2f6989410eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:10.746274 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1150/2311] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:10.756011 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:10.757486 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:10.817207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28993-a553-4f83-a00e-79eb8219ebfe admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:10.820819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f35c7-e6bf-42e0-8d93-c79314ebe7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:10.821440 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f35c7-e6bf-42e0-8d93-c79314ebe7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:10.821719 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f35c7-e6bf-42e0-8d93-c79314ebe7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:10.821992 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f35c7-e6bf-42e0-8d93-c79314ebe7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:10.833439 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f35c7-e6bf-42e0-8d93-c79314ebe7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:10.834926 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f35c7-e6bf-42e0-8d93-c79314ebe7e6 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:10.845784 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1162/2312] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:26:11.030900 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067cfa7-e9a6-4c90-b3ab-25c30388ede6 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:11.031339 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067cfa7-e9a6-4c90-b3ab-25c30388ede6 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:11.031727 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067cfa7-e9a6-4c90-b3ab-25c30388ede6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:11.051704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-3067cfa7-e9a6-4c90-b3ab-25c30388ede6 None None] MFA Rules not processed for user `553e6c84f36e49c7964a593a42122412`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:11.053096 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-3067cfa7-e9a6-4c90-b3ab-25c30388ede6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:11.131769 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1151/2313] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:11.155223 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f35c7-e6bf-42e0-8d93-c79314ebe7e6 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:11.157713 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-690f35c7-e6bf-42e0-8d93-c79314ebe7e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:11.175525 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f35c7-e6bf-42e0-8d93-c79314ebe7e6 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:11.182769 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:11.191738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:11.191738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:11.191738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] PATH_INFO: `/v3/projects/dbda3c76626a455faa1a8e115d850155` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:11.191738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbda3c76626a455faa1a8e115d850155)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:11.191738 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:11.214819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:11.253808 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbda3c76626a455faa1a8e115d850155', 'request_id': 'req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.260448 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbda3c76626a455faa1a8e115d850155', 'request_id': 'req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.266787 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbda3c76626a455faa1a8e115d850155', 'request_id': 'req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.281528 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] The token cache is being invalidate because project dbda3c76626a455faa1a8e115d850155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:26:11.281927 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.282659 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.284305 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1163/2314] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:26:11 2022] DELETE /identity/v3/projects/dbda3c76626a455faa1a8e115d850155 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:11.289044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067cfa7-e9a6-4c90-b3ab-25c30388ede6 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:11.300071 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067cfa7-e9a6-4c90-b3ab-25c30388ede6 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:11.364205 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c310e-0c03-4f10-bf84-4a54fb17638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:11.364869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c310e-0c03-4f10-bf84-4a54fb17638f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:11.365149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c310e-0c03-4f10-bf84-4a54fb17638f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:11.367652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c310e-0c03-4f10-bf84-4a54fb17638f admin admin] PATH_INFO: `/v3/users/e9ddd6dbd30742d2855fff3a499e552e` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:11.368547 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c310e-0c03-4f10-bf84-4a54fb17638f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ddd6dbd30742d2855fff3a499e552e)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:11.370583 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c310e-0c03-4f10-bf84-4a54fb17638f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:11.420797 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-fc4c310e-0c03-4f10-bf84-4a54fb17638f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ddd6dbd30742d2855fff3a499e552e'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.421663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-fc4c310e-0c03-4f10-bf84-4a54fb17638f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ddd6dbd30742d2855fff3a499e552e'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.423502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:11.432220 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-fc4c310e-0c03-4f10-bf84-4a54fb17638f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ddd6dbd30742d2855fff3a499e552e'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.449285 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-fc4c310e-0c03-4f10-bf84-4a54fb17638f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ddd6dbd30742d2855fff3a499e552e'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.450054 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-fc4c310e-0c03-4f10-bf84-4a54fb17638f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ddd6dbd30742d2855fff3a499e552e'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.466749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1152/2315] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:26:11 2022] DELETE /identity/v3/users/e9ddd6dbd30742d2855fff3a499e552e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:11.801441 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:11.803346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:11.818307 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452b4c6-84e1-4bd9-bfc3-dc6b9f423a3d admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:11.895058 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:11.895723 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:11.896059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:11.896339 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] PATH_INFO: `/v3/projects/9d6f1a68427245c881c2772e5686698b` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:11.897690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6f1a68427245c881c2772e5686698b)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:11.899903 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:11.964380 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6f1a68427245c881c2772e5686698b', 'request_id': 'req-90b7a681-1b59-400b-af58-6d13ad100483'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.970824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6f1a68427245c881c2772e5686698b', 'request_id': 'req-90b7a681-1b59-400b-af58-6d13ad100483'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.977514 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6f1a68427245c881c2772e5686698b', 'request_id': 'req-90b7a681-1b59-400b-af58-6d13ad100483'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.992319 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] The token cache is being invalidate because project 9d6f1a68427245c881c2772e5686698b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:26:11.992581 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:11.995173 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-90b7a681-1b59-400b-af58-6d13ad100483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:12.000257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1164/2316] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:26:11 2022] DELETE /identity/v3/projects/9d6f1a68427245c881c2772e5686698b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:12.001910 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fadb8-5608-4eba-92b9-8f311be22a64 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.002877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fadb8-5608-4eba-92b9-8f311be22a64 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.002877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fadb8-5608-4eba-92b9-8f311be22a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.024831 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-e87fadb8-5608-4eba-92b9-8f311be22a64 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:12.026263 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e87fadb8-5608-4eba-92b9-8f311be22a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:12.106334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1153/2317] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:12.114537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e539e-7762-4620-9da1-6d8d77028af5 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.114908 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e539e-7762-4620-9da1-6d8d77028af5 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.115087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e539e-7762-4620-9da1-6d8d77028af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.139447 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-092e539e-7762-4620-9da1-6d8d77028af5 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:12.141404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-092e539e-7762-4620-9da1-6d8d77028af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:12.154427 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1165/2318] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:12.158730 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fadb8-5608-4eba-92b9-8f311be22a64 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:12.168678 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fadb8-5608-4eba-92b9-8f311be22a64 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:12.173537 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdccca4-56df-48df-b38b-1a419ca5e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:12.174229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdccca4-56df-48df-b38b-1a419ca5e067 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.174997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdccca4-56df-48df-b38b-1a419ca5e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.174997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdccca4-56df-48df-b38b-1a419ca5e067 admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.176098 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdccca4-56df-48df-b38b-1a419ca5e067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:26:12.176277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdccca4-56df-48df-b38b-1a419ca5e067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:12.177886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdccca4-56df-48df-b38b-1a419ca5e067 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:12.194536 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1154/2319] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:26:12.198346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e539e-7762-4620-9da1-6d8d77028af5 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:12.208526 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e539e-7762-4620-9da1-6d8d77028af5 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:12.216434 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d98f08-661b-4755-b324-d5c8e5d62070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:12.217162 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d98f08-661b-4755-b324-d5c8e5d62070 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.217568 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d98f08-661b-4755-b324-d5c8e5d62070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.217801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d98f08-661b-4755-b324-d5c8e5d62070 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.218535 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d98f08-661b-4755-b324-d5c8e5d62070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:12.220840 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d98f08-661b-4755-b324-d5c8e5d62070 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:12.257852 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1166/2320] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:26:12 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:26:12.261915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdccca4-56df-48df-b38b-1a419ca5e067 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:12.272949 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdccca4-56df-48df-b38b-1a419ca5e067 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:12.364235 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3ddb-09e4-4822-aceb-370c71767c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:12.365509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3ddb-09e4-4822-aceb-370c71767c6b admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.366467 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3ddb-09e4-4822-aceb-370c71767c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.366768 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3ddb-09e4-4822-aceb-370c71767c6b admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.367755 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d3ddb-09e4-4822-aceb-370c71767c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:12.369951 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d3ddb-09e4-4822-aceb-370c71767c6b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:12.401971 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1155/2321] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:26:12 2022] POST /identity/v3/users => generated 284 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 08:26:12.407491 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d98f08-661b-4755-b324-d5c8e5d62070 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:12.418814 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d98f08-661b-4755-b324-d5c8e5d62070 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:12.424504 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50118f-312e-44e2-997c-74d0afe50d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:12.425202 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50118f-312e-44e2-997c-74d0afe50d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.425571 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50118f-312e-44e2-997c-74d0afe50d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.425879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50118f-312e-44e2-997c-74d0afe50d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.430040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50118f-312e-44e2-997c-74d0afe50d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:12.430040 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50118f-312e-44e2-997c-74d0afe50d43 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:12.430921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:12.440900 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1167/2322] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:26:12.444913 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3ddb-09e4-4822-aceb-370c71767c6b admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:12.455487 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3ddb-09e4-4822-aceb-370c71767c6b admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:12.460190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ff94d-a8ef-4a32-8336-5b831b35cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:12.460805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff94d-a8ef-4a32-8336-5b831b35cd4f admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.461094 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff94d-a8ef-4a32-8336-5b831b35cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.461360 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ff94d-a8ef-4a32-8336-5b831b35cd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.462099 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ff94d-a8ef-4a32-8336-5b831b35cd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:12.463691 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ff94d-a8ef-4a32-8336-5b831b35cd4f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:12.474887 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1156/2323] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:26:12.479772 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50118f-312e-44e2-997c-74d0afe50d43 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:12.490002 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50118f-312e-44e2-997c-74d0afe50d43 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:12.495233 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9ca55-bf6d-48a9-acf9-14a9b8820249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:12.495899 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ca55-bf6d-48a9-acf9-14a9b8820249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.496180 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ca55-bf6d-48a9-acf9-14a9b8820249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.496454 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ca55-bf6d-48a9-acf9-14a9b8820249 admin admin] PATH_INFO: `/v3/projects/89f66b690fd046758d6a4eb5f1d531ff/users/b13ee243dcd1481fbe156c31e9691778/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.511520 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9ca55-bf6d-48a9-acf9-14a9b8820249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f66b690fd046758d6a4eb5f1d531ff, user_id=b13ee243dcd1481fbe156c31e9691778, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:12.514449 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9ca55-bf6d-48a9-acf9-14a9b8820249 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:12.529183 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1168/2324] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:26:12 2022] PUT /identity/v3/projects/89f66b690fd046758d6a4eb5f1d531ff/users/b13ee243dcd1481fbe156c31e9691778/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:12.541326 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6b41-163e-4a61-90bc-d66db4dc87b9 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.541636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6b41-163e-4a61-90bc-d66db4dc87b9 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.541920 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e6b41-163e-4a61-90bc-d66db4dc87b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.571087 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-855e6b41-163e-4a61-90bc-d66db4dc87b9 None None] MFA Rules not processed for user `b13ee243dcd1481fbe156c31e9691778`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:12.572327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-855e6b41-163e-4a61-90bc-d66db4dc87b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:12.591931 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:12.641238 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1157/2325] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:12.644959 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9ca55-bf6d-48a9-acf9-14a9b8820249 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:12.708475 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9ca55-bf6d-48a9-acf9-14a9b8820249 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:12.713718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2974cd-c25f-4158-9022-e14ac530044c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:12.714373 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2974cd-c25f-4158-9022-e14ac530044c admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.714656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2974cd-c25f-4158-9022-e14ac530044c admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.714931 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2974cd-c25f-4158-9022-e14ac530044c admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.715608 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2974cd-c25f-4158-9022-e14ac530044c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:12.717515 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2974cd-c25f-4158-9022-e14ac530044c admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:12.749005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1169/2326] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:26:12 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:26:12.752805 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6b41-163e-4a61-90bc-d66db4dc87b9 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:12.764348 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e6b41-163e-4a61-90bc-d66db4dc87b9 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:12.825122 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676a036-3034-4146-8f86-6be447b33d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:12.825781 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676a036-3034-4146-8f86-6be447b33d56 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.826289 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676a036-3034-4146-8f86-6be447b33d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.826564 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676a036-3034-4146-8f86-6be447b33d56 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.827251 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676a036-3034-4146-8f86-6be447b33d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:12.829193 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676a036-3034-4146-8f86-6be447b33d56 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:12.859474 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1158/2327] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:26:12 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:26:12.860796 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2974cd-c25f-4158-9022-e14ac530044c admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:12.873221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2974cd-c25f-4158-9022-e14ac530044c admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:12.880029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444ddad-afac-4f60-884c-b01bc6659442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:12.882488 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ddad-afac-4f60-884c-b01bc6659442 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.882488 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ddad-afac-4f60-884c-b01bc6659442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.883527 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444ddad-afac-4f60-884c-b01bc6659442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.884511 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444ddad-afac-4f60-884c-b01bc6659442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:12.886941 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444ddad-afac-4f60-884c-b01bc6659442 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:12.904246 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1170/2328] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:26:12.908174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676a036-3034-4146-8f86-6be447b33d56 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:12.920461 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676a036-3034-4146-8f86-6be447b33d56 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:12.925145 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda08d73-ad64-44c5-a7b6-e3ee1ce2611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:12.925859 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08d73-ad64-44c5-a7b6-e3ee1ce2611c admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:12.926163 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08d73-ad64-44c5-a7b6-e3ee1ce2611c admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:12.926440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda08d73-ad64-44c5-a7b6-e3ee1ce2611c admin admin] PATH_INFO: `/v3/projects/979af1e298ab4585be29fd7931baba6c/users/80df6a22a42f45339b789a75fc52b89b/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:12.943589 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda08d73-ad64-44c5-a7b6-e3ee1ce2611c admin admin] RBAC: Authorizing `identity:create_grant(project_id=979af1e298ab4585be29fd7931baba6c, user_id=80df6a22a42f45339b789a75fc52b89b, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:12.946303 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda08d73-ad64-44c5-a7b6-e3ee1ce2611c admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:12.961392 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1159/2329] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:26:12 2022] PUT /identity/v3/projects/979af1e298ab4585be29fd7931baba6c/users/80df6a22a42f45339b789a75fc52b89b/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:12.965703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444ddad-afac-4f60-884c-b01bc6659442 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:12.976584 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444ddad-afac-4f60-884c-b01bc6659442 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:13.038094 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f7ada-8bdb-4482-aedc-f916885a19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:13.038718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7ada-8bdb-4482-aedc-f916885a19dd admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:13.038998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7ada-8bdb-4482-aedc-f916885a19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:13.039271 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f7ada-8bdb-4482-aedc-f916885a19dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:13.039974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f7ada-8bdb-4482-aedc-f916885a19dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:13.041736 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f7ada-8bdb-4482-aedc-f916885a19dd admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:13.052042 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1171/2330] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:26:13.056254 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda08d73-ad64-44c5-a7b6-e3ee1ce2611c admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:13.066775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda08d73-ad64-44c5-a7b6-e3ee1ce2611c admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:13.072042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d0c49-8e6e-4fb4-98c6-c0d7d00d84d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:13.072722 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0c49-8e6e-4fb4-98c6-c0d7d00d84d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:13.073003 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0c49-8e6e-4fb4-98c6-c0d7d00d84d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:13.073280 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d0c49-8e6e-4fb4-98c6-c0d7d00d84d1 admin admin] PATH_INFO: `/v3/projects/979af1e298ab4585be29fd7931baba6c/users/80df6a22a42f45339b789a75fc52b89b/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:13.075716 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d0c49-8e6e-4fb4-98c6-c0d7d00d84d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979af1e298ab4585be29fd7931baba6c, user_id=80df6a22a42f45339b789a75fc52b89b, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:13.079240 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d0c49-8e6e-4fb4-98c6-c0d7d00d84d1 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:13.090893 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1160/2331] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:26:13 2022] PUT /identity/v3/projects/979af1e298ab4585be29fd7931baba6c/users/80df6a22a42f45339b789a75fc52b89b/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:13.101387 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f81f-06bb-4af6-b2de-6551efcd4aab None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:13.101672 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f81f-06bb-4af6-b2de-6551efcd4aab None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:13.101951 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f81f-06bb-4af6-b2de-6551efcd4aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:13.129771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d5c0f81f-06bb-4af6-b2de-6551efcd4aab None None] MFA Rules not processed for user `80df6a22a42f45339b789a75fc52b89b`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:13.131022 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d5c0f81f-06bb-4af6-b2de-6551efcd4aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:13.164138 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:13.204505 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1172/2332] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:13.216581 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d0c49-8e6e-4fb4-98c6-c0d7d00d84d1 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:13.218328 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-c47d0c49-8e6e-4fb4-98c6-c0d7d00d84d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:13.281268 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d0c49-8e6e-4fb4-98c6-c0d7d00d84d1 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:13.284894 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a1847-c370-4ad0-a4bd-bc820d0625f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:13.285511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a1847-c370-4ad0-a4bd-bc820d0625f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:13.285788 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a1847-c370-4ad0-a4bd-bc820d0625f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:13.286096 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a1847-c370-4ad0-a4bd-bc820d0625f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:13.295546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a1847-c370-4ad0-a4bd-bc820d0625f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:13.296961 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a1847-c370-4ad0-a4bd-bc820d0625f4 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:13.306869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1161/2333] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:26:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:26:13.390029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0f81f-06bb-4af6-b2de-6551efcd4aab None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:13.399836 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0f81f-06bb-4af6-b2de-6551efcd4aab None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:13.403438 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc6332-9c0c-4079-91d3-b6630d9075d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:13.404054 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc6332-9c0c-4079-91d3-b6630d9075d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:13.404330 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc6332-9c0c-4079-91d3-b6630d9075d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:13.404601 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc6332-9c0c-4079-91d3-b6630d9075d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:13.466187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc6332-9c0c-4079-91d3-b6630d9075d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:13.467624 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc6332-9c0c-4079-91d3-b6630d9075d5 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:13.477881 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1173/2334] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:26:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:26:18.702962 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a1847-c370-4ad0-a4bd-bc820d0625f4 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:18.721009 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:18.771631 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a1847-c370-4ad0-a4bd-bc820d0625f4 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:18.776566 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:18.777228 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:18.777510 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:18.777799 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] PATH_INFO: `/v3/users/b13ee243dcd1481fbe156c31e9691778` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:18.779112 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13ee243dcd1481fbe156c31e9691778)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:18.781027 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:18.830960 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13ee243dcd1481fbe156c31e9691778'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:18.831610 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13ee243dcd1481fbe156c31e9691778'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:18.839919 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13ee243dcd1481fbe156c31e9691778'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:18.856208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13ee243dcd1481fbe156c31e9691778'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:18.857067 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13ee243dcd1481fbe156c31e9691778'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:18.871217 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1162/2335] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:26:18 2022] DELETE /identity/v3/users/b13ee243dcd1481fbe156c31e9691778 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:18.876019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de687fad-cedb-4fcc-8f1e-cac7abae76a0 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:18.876566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de687fad-cedb-4fcc-8f1e-cac7abae76a0 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:18.876566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de687fad-cedb-4fcc-8f1e-cac7abae76a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:18.897832 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-de687fad-cedb-4fcc-8f1e-cac7abae76a0 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:18.899113 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-de687fad-cedb-4fcc-8f1e-cac7abae76a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:18.965757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1174/2336] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:18.976985 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:18.978839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:19.045252 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13865ccc-66d4-466b-a978-14172be36ccd admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:19.049042 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ccb65-1f7d-4852-9753-fdb2cc361dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:19.049683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ccb65-1f7d-4852-9753-fdb2cc361dae service neutron] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:19.049957 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ccb65-1f7d-4852-9753-fdb2cc361dae service neutron] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:19.050375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ccb65-1f7d-4852-9753-fdb2cc361dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:19.060277 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ccb65-1f7d-4852-9753-fdb2cc361dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:19.061792 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ccb65-1f7d-4852-9753-fdb2cc361dae service neutron] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:19.072010 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1163/2337] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:26:19.362301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de687fad-cedb-4fcc-8f1e-cac7abae76a0 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:19.364079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-de687fad-cedb-4fcc-8f1e-cac7abae76a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:19.383647 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de687fad-cedb-4fcc-8f1e-cac7abae76a0 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:19.388688 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:19.389364 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:19.389639 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:19.389915 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] PATH_INFO: `/v3/projects/89f66b690fd046758d6a4eb5f1d531ff` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:19.391156 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f66b690fd046758d6a4eb5f1d531ff)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:19.393128 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:19.453676 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f66b690fd046758d6a4eb5f1d531ff', 'request_id': 'req-e2253931-e32c-4176-b49e-fbb3d7aa8d78'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:19.461575 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f66b690fd046758d6a4eb5f1d531ff', 'request_id': 'req-e2253931-e32c-4176-b49e-fbb3d7aa8d78'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:19.468074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f66b690fd046758d6a4eb5f1d531ff', 'request_id': 'req-e2253931-e32c-4176-b49e-fbb3d7aa8d78'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:19.470274 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:19.484159 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] The token cache is being invalidate because project 89f66b690fd046758d6a4eb5f1d531ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:26:19.484456 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:19.485118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:19.486740 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1175/2338] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:26:19 2022] DELETE /identity/v3/projects/89f66b690fd046758d6a4eb5f1d531ff => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:19.492649 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ccb65-1f7d-4852-9753-fdb2cc361dae service neutron] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:19.503058 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ccb65-1f7d-4852-9753-fdb2cc361dae service neutron] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:19.555963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:19.583990 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff1736-70f9-4d0a-91d2-9191ca6fbc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:19.584652 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff1736-70f9-4d0a-91d2-9191ca6fbc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:19.584936 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff1736-70f9-4d0a-91d2-9191ca6fbc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:19.585214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff1736-70f9-4d0a-91d2-9191ca6fbc44 admin admin] PATH_INFO: `/v3/users/80df6a22a42f45339b789a75fc52b89b` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:19.586550 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff1736-70f9-4d0a-91d2-9191ca6fbc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80df6a22a42f45339b789a75fc52b89b)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:19.588501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff1736-70f9-4d0a-91d2-9191ca6fbc44 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:19.642318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-61ff1736-70f9-4d0a-91d2-9191ca6fbc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80df6a22a42f45339b789a75fc52b89b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:19.642997 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-61ff1736-70f9-4d0a-91d2-9191ca6fbc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80df6a22a42f45339b789a75fc52b89b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:19.653830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-61ff1736-70f9-4d0a-91d2-9191ca6fbc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80df6a22a42f45339b789a75fc52b89b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:19.667103 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-61ff1736-70f9-4d0a-91d2-9191ca6fbc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80df6a22a42f45339b789a75fc52b89b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:19.667836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-61ff1736-70f9-4d0a-91d2-9191ca6fbc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80df6a22a42f45339b789a75fc52b89b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:19.680917 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1164/2339] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:26:19 2022] DELETE /identity/v3/users/80df6a22a42f45339b789a75fc52b89b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:19.982221 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:19.983742 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:19.997837 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2253931-e32c-4176-b49e-fbb3d7aa8d78 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:20.074090 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:20.074916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:20.075067 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:20.075505 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] PATH_INFO: `/v3/projects/979af1e298ab4585be29fd7931baba6c` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:20.076692 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] RBAC: Authorizing `identity:delete_project(project_id=979af1e298ab4585be29fd7931baba6c)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:20.078887 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:20.132547 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979af1e298ab4585be29fd7931baba6c', 'request_id': 'req-b78e5e48-46df-4d31-bf68-d22080e02add'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:20.139039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979af1e298ab4585be29fd7931baba6c', 'request_id': 'req-b78e5e48-46df-4d31-bf68-d22080e02add'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:20.145089 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979af1e298ab4585be29fd7931baba6c', 'request_id': 'req-b78e5e48-46df-4d31-bf68-d22080e02add'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:20.157916 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] The token cache is being invalidate because project 979af1e298ab4585be29fd7931baba6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:26:20.158247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:20.158885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-b78e5e48-46df-4d31-bf68-d22080e02add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:20.160424 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1176/2340] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:26:19 2022] DELETE /identity/v3/projects/979af1e298ab4585be29fd7931baba6c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:20.171541 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7309698-da73-42ce-a0b0-8aa2bdff76de None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:20.172044 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7309698-da73-42ce-a0b0-8aa2bdff76de None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:20.172158 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7309698-da73-42ce-a0b0-8aa2bdff76de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:20.192790 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-e7309698-da73-42ce-a0b0-8aa2bdff76de None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:20.194560 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e7309698-da73-42ce-a0b0-8aa2bdff76de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:20.254128 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1165/2341] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:20.263061 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e008-6021-477d-b9e2-c8d79f2916ac None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:20.263351 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e008-6021-477d-b9e2-c8d79f2916ac None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:20.263632 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544e008-6021-477d-b9e2-c8d79f2916ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:20.283957 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-b544e008-6021-477d-b9e2-c8d79f2916ac None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:20.285175 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b544e008-6021-477d-b9e2-c8d79f2916ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:20.293564 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1177/2342] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:20.297877 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7309698-da73-42ce-a0b0-8aa2bdff76de None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:20.307791 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7309698-da73-42ce-a0b0-8aa2bdff76de None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:20.312520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a363d0-b698-4825-88bc-b2a3366d106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:20.313141 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a363d0-b698-4825-88bc-b2a3366d106f admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:20.313423 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a363d0-b698-4825-88bc-b2a3366d106f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:20.313698 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a363d0-b698-4825-88bc-b2a3366d106f admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:20.314427 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a363d0-b698-4825-88bc-b2a3366d106f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:26:20.314736 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a363d0-b698-4825-88bc-b2a3366d106f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:20.316318 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a363d0-b698-4825-88bc-b2a3366d106f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:20.332208 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1166/2343] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:26:20.333349 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544e008-6021-477d-b9e2-c8d79f2916ac None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:20.344560 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544e008-6021-477d-b9e2-c8d79f2916ac None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:20.353690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42bb1d-a2aa-4aaa-88d7-bf44b43ea4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:20.354472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42bb1d-a2aa-4aaa-88d7-bf44b43ea4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:20.354821 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42bb1d-a2aa-4aaa-88d7-bf44b43ea4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:20.355163 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42bb1d-a2aa-4aaa-88d7-bf44b43ea4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:20.355942 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42bb1d-a2aa-4aaa-88d7-bf44b43ea4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:20.358087 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42bb1d-a2aa-4aaa-88d7-bf44b43ea4a8 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:20.388366 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1178/2344] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:26:20 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:26:20.395975 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a363d0-b698-4825-88bc-b2a3366d106f admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:20.407766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a363d0-b698-4825-88bc-b2a3366d106f admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:20.470041 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:20.489112 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff67645-8365-49cd-8e82-06783f780357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:20.489746 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67645-8365-49cd-8e82-06783f780357 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:20.490050 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67645-8365-49cd-8e82-06783f780357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:20.490845 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67645-8365-49cd-8e82-06783f780357 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:20.491527 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff67645-8365-49cd-8e82-06783f780357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:20.493440 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff67645-8365-49cd-8e82-06783f780357 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:20.518683 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1167/2345] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:26:20 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:26:20.522899 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42bb1d-a2aa-4aaa-88d7-bf44b43ea4a8 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:20.534068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42bb1d-a2aa-4aaa-88d7-bf44b43ea4a8 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:20.538761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8f4a4-aba7-432c-9611-f390fb3e7aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:20.539377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8f4a4-aba7-432c-9611-f390fb3e7aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:20.539657 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8f4a4-aba7-432c-9611-f390fb3e7aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:20.539988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8f4a4-aba7-432c-9611-f390fb3e7aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:20.540656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8f4a4-aba7-432c-9611-f390fb3e7aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:20.542391 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a8f4a4-aba7-432c-9611-f390fb3e7aa8 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:20.556165 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1179/2346] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:26:20.560476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff67645-8365-49cd-8e82-06783f780357 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:20.571327 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff67645-8365-49cd-8e82-06783f780357 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:20.576107 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe56e65-b1fa-43cb-a61b-68f84fb5deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:20.576717 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe56e65-b1fa-43cb-a61b-68f84fb5deea admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:20.577000 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe56e65-b1fa-43cb-a61b-68f84fb5deea admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:20.577266 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe56e65-b1fa-43cb-a61b-68f84fb5deea admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:20.577961 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe56e65-b1fa-43cb-a61b-68f84fb5deea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:20.579614 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe56e65-b1fa-43cb-a61b-68f84fb5deea admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:20.590952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1168/2347] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:26:20.595508 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8f4a4-aba7-432c-9611-f390fb3e7aa8 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:20.606179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a8f4a4-aba7-432c-9611-f390fb3e7aa8 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:20.610898 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bf34d-0a71-4904-9a0f-e87281e44399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:20.611564 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bf34d-0a71-4904-9a0f-e87281e44399 admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:20.611844 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bf34d-0a71-4904-9a0f-e87281e44399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:20.612125 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bf34d-0a71-4904-9a0f-e87281e44399 admin admin] PATH_INFO: `/v3/projects/05a6a7d18ac64f1ebf28b9fda2ac6ec5/users/fefd3bbf4d084d709dcb83064ede219b/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:20.627974 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bf34d-0a71-4904-9a0f-e87281e44399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a6a7d18ac64f1ebf28b9fda2ac6ec5, user_id=fefd3bbf4d084d709dcb83064ede219b, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:20.630695 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bf34d-0a71-4904-9a0f-e87281e44399 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:20.645712 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1180/2348] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:26:20 2022] PUT /identity/v3/projects/05a6a7d18ac64f1ebf28b9fda2ac6ec5/users/fefd3bbf4d084d709dcb83064ede219b/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:20.651174 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e085cda-daa3-4db1-b20b-9905d3d17d3a None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:20.651481 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e085cda-daa3-4db1-b20b-9905d3d17d3a None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:20.651764 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e085cda-daa3-4db1-b20b-9905d3d17d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:20.671826 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-6e085cda-daa3-4db1-b20b-9905d3d17d3a None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:20.673048 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6e085cda-daa3-4db1-b20b-9905d3d17d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:20.734906 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1169/2349] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:20.745105 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bf34d-0a71-4904-9a0f-e87281e44399 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:20.746980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-c04bf34d-0a71-4904-9a0f-e87281e44399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:20.766843 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:20.814660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bf34d-0a71-4904-9a0f-e87281e44399 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:20.819115 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e29bde-c2f0-4b6a-9af4-e55965061274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:20.819747 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29bde-c2f0-4b6a-9af4-e55965061274 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:20.820039 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29bde-c2f0-4b6a-9af4-e55965061274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:20.820318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29bde-c2f0-4b6a-9af4-e55965061274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:20.831257 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e29bde-c2f0-4b6a-9af4-e55965061274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:20.832755 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e29bde-c2f0-4b6a-9af4-e55965061274 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:20.843106 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1181/2350] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:26:21.501091 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1131d-bd97-4b94-b3f2-9170d258cee1 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:21.501663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1131d-bd97-4b94-b3f2-9170d258cee1 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:21.501663 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1131d-bd97-4b94-b3f2-9170d258cee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:21.531528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-05c1131d-bd97-4b94-b3f2-9170d258cee1 None None] MFA Rules not processed for user `fefd3bbf4d084d709dcb83064ede219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:21.535535 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-05c1131d-bd97-4b94-b3f2-9170d258cee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:21.637733 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1170/2351] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:21.641907 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e29bde-c2f0-4b6a-9af4-e55965061274 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:21.653059 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e29bde-c2f0-4b6a-9af4-e55965061274 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:21.658661 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9869e-2ca7-445c-a92c-93295690c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:21.659472 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9869e-2ca7-445c-a92c-93295690c22b admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:21.659854 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9869e-2ca7-445c-a92c-93295690c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:21.660236 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9869e-2ca7-445c-a92c-93295690c22b admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:21.661027 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9869e-2ca7-445c-a92c-93295690c22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:21.663226 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9869e-2ca7-445c-a92c-93295690c22b admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:21.730075 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1182/2352] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:26:21 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:26:21.734164 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1131d-bd97-4b94-b3f2-9170d258cee1 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:21.748115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1131d-bd97-4b94-b3f2-9170d258cee1 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:21.806371 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:21.817829 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c7b20-1d6d-49b9-bab3-3fc792bf6e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:21.819475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7b20-1d6d-49b9-bab3-3fc792bf6e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:21.820047 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7b20-1d6d-49b9-bab3-3fc792bf6e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:21.820795 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7b20-1d6d-49b9-bab3-3fc792bf6e86 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:21.821856 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c7b20-1d6d-49b9-bab3-3fc792bf6e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:21.825195 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c7b20-1d6d-49b9-bab3-3fc792bf6e86 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:21.849945 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1171/2353] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:26:21 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:26:21.855455 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9869e-2ca7-445c-a92c-93295690c22b admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:21.866214 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9869e-2ca7-445c-a92c-93295690c22b admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:21.871170 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f6d03-20c2-4e09-abce-2e38eeabd781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:21.871856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6d03-20c2-4e09-abce-2e38eeabd781 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:21.872130 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6d03-20c2-4e09-abce-2e38eeabd781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:21.872377 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f6d03-20c2-4e09-abce-2e38eeabd781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:21.873152 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f6d03-20c2-4e09-abce-2e38eeabd781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:21.874807 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f6d03-20c2-4e09-abce-2e38eeabd781 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:21.887825 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1183/2354] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:26:21.892052 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c7b20-1d6d-49b9-bab3-3fc792bf6e86 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:21.903622 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c7b20-1d6d-49b9-bab3-3fc792bf6e86 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:21.909808 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aeee23-201e-4bed-bff0-d6031dfc3208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:21.910522 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aeee23-201e-4bed-bff0-d6031dfc3208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:21.910806 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aeee23-201e-4bed-bff0-d6031dfc3208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:21.911081 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aeee23-201e-4bed-bff0-d6031dfc3208 admin admin] PATH_INFO: `/v3/projects/e574cb138e4442058b7ecddac9804742/users/623e72f7412143e98bb9ed9004dd0159/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:21.928954 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aeee23-201e-4bed-bff0-d6031dfc3208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e574cb138e4442058b7ecddac9804742, user_id=623e72f7412143e98bb9ed9004dd0159, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:21.931780 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aeee23-201e-4bed-bff0-d6031dfc3208 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:21.951754 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1172/2355] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:26:21 2022] PUT /identity/v3/projects/e574cb138e4442058b7ecddac9804742/users/623e72f7412143e98bb9ed9004dd0159/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:21.955833 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f6d03-20c2-4e09-abce-2e38eeabd781 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:21.971143 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f6d03-20c2-4e09-abce-2e38eeabd781 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:22.033381 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e0ed1-b10a-4302-86af-772d9f8be8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:22.034537 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e0ed1-b10a-4302-86af-772d9f8be8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:22.035008 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e0ed1-b10a-4302-86af-772d9f8be8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:22.035407 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e0ed1-b10a-4302-86af-772d9f8be8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:22.036595 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e0ed1-b10a-4302-86af-772d9f8be8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:22.038904 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e0ed1-b10a-4302-86af-772d9f8be8a3 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:22.049841 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1184/2356] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:26:22.054528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aeee23-201e-4bed-bff0-d6031dfc3208 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:22.065830 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aeee23-201e-4bed-bff0-d6031dfc3208 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:22.072237 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4977f3-278c-4856-bc67-519826e69ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:22.072940 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4977f3-278c-4856-bc67-519826e69ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:22.073226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4977f3-278c-4856-bc67-519826e69ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:22.073507 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4977f3-278c-4856-bc67-519826e69ec4 admin admin] PATH_INFO: `/v3/projects/e574cb138e4442058b7ecddac9804742/users/623e72f7412143e98bb9ed9004dd0159/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:22.075669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4977f3-278c-4856-bc67-519826e69ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e574cb138e4442058b7ecddac9804742, user_id=623e72f7412143e98bb9ed9004dd0159, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:22.078397 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4977f3-278c-4856-bc67-519826e69ec4 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:22.089380 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1173/2357] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:26:22 2022] PUT /identity/v3/projects/e574cb138e4442058b7ecddac9804742/users/623e72f7412143e98bb9ed9004dd0159/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:22.752644 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3523e7b-03f9-4ecf-b85d-8fda028863aa None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:22.757127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3523e7b-03f9-4ecf-b85d-8fda028863aa None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:22.757616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3523e7b-03f9-4ecf-b85d-8fda028863aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:22.794328 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-b3523e7b-03f9-4ecf-b85d-8fda028863aa None None] MFA Rules not processed for user `623e72f7412143e98bb9ed9004dd0159`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:22.795987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-b3523e7b-03f9-4ecf-b85d-8fda028863aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:22.902164 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1185/2358] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:22.912956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4977f3-278c-4856-bc67-519826e69ec4 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:22.916625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-6c4977f3-278c-4856-bc67-519826e69ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:22.990321 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4977f3-278c-4856-bc67-519826e69ec4 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:22.996247 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7142aa-a566-43bc-a78f-145296b52200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:22.996883 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7142aa-a566-43bc-a78f-145296b52200 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:22.997164 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7142aa-a566-43bc-a78f-145296b52200 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:22.997441 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7142aa-a566-43bc-a78f-145296b52200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:23.054960 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7142aa-a566-43bc-a78f-145296b52200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:23.056393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7142aa-a566-43bc-a78f-145296b52200 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:23.065306 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1174/2359] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:26:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:26:24.449921 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3523e7b-03f9-4ecf-b85d-8fda028863aa None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:24.460081 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3523e7b-03f9-4ecf-b85d-8fda028863aa None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:24.463593 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55158052-45e9-4577-ae83-52bec4f4e8e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:24.464205 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55158052-45e9-4577-ae83-52bec4f4e8e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:24.464480 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55158052-45e9-4577-ae83-52bec4f4e8e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:24.464750 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55158052-45e9-4577-ae83-52bec4f4e8e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:24.470775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:24.476551 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55158052-45e9-4577-ae83-52bec4f4e8e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:24.479761 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55158052-45e9-4577-ae83-52bec4f4e8e3 service cinder] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:24.492868 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1186/2360] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:26:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:26:33.061319 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=68,keystone:INSERT=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:34.487801 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:44.892450 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7142aa-a566-43bc-a78f-145296b52200 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:44.893947 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-ff7142aa-a566-43bc-a78f-145296b52200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:44.965289 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7142aa-a566-43bc-a78f-145296b52200 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:44.970518 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35ee66-b31f-412e-ba15-242a12033e15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3318842c46ec4c6d9b7b1f55c9fab62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:44.971142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35ee66-b31f-412e-ba15-242a12033e15 service placement] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:44.971425 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35ee66-b31f-412e-ba15-242a12033e15 service placement] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:44.971693 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35ee66-b31f-412e-ba15-242a12033e15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:44.973468 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-1b35ee66-b31f-412e-ba15-242a12033e15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:44.985374 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35ee66-b31f-412e-ba15-242a12033e15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:44.986979 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35ee66-b31f-412e-ba15-242a12033e15 service placement] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:44.997119 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1175/2361] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:26:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:26:47.892557 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6a7ad-9768-489e-87e7-3efc5e896df8 None None] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:47.893057 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6a7ad-9768-489e-87e7-3efc5e896df8 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:47.893243 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6a7ad-9768-489e-87e7-3efc5e896df8 None None] PATH_INFO: `/` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:47.894965 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1187/2362] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 08:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 08:26:47.904886 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df57d6d-b746-47db-a89c-13ace8f60992 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:47.905393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df57d6d-b746-47db-a89c-13ace8f60992 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:47.905493 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df57d6d-b746-47db-a89c-13ace8f60992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:47.926766 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-1df57d6d-b746-47db-a89c-13ace8f60992 None None] MFA Rules not processed for user `3318842c46ec4c6d9b7b1f55c9fab62b`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:47.928002 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-1df57d6d-b746-47db-a89c-13ace8f60992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:47.937248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1176/2363] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 08:26:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:47.949120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6a7ad-9768-489e-87e7-3efc5e896df8 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:47.968318 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6a7ad-9768-489e-87e7-3efc5e896df8 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:47.976153 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330deaf-8d0b-47fa-aafb-45c62a9022a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3318842c46ec4c6d9b7b1f55c9fab62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:47.977410 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330deaf-8d0b-47fa-aafb-45c62a9022a9 service placement] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:47.978079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330deaf-8d0b-47fa-aafb-45c62a9022a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:47.978726 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330deaf-8d0b-47fa-aafb-45c62a9022a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:47.995365 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330deaf-8d0b-47fa-aafb-45c62a9022a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:47.997127 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330deaf-8d0b-47fa-aafb-45c62a9022a9 service placement] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:48.008473 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1188/2364] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:26:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:26:48.522199 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df57d6d-b746-47db-a89c-13ace8f60992 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:48.592870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df57d6d-b746-47db-a89c-13ace8f60992 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:48.597423 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:48.598105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:48.598383 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:48.598653 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] PATH_INFO: `/v3/users/fefd3bbf4d084d709dcb83064ede219b` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:48.600340 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefd3bbf4d084d709dcb83064ede219b)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:48.602453 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:48.652775 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefd3bbf4d084d709dcb83064ede219b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:48.653743 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefd3bbf4d084d709dcb83064ede219b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:48.661630 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefd3bbf4d084d709dcb83064ede219b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:48.674454 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefd3bbf4d084d709dcb83064ede219b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:48.675153 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefd3bbf4d084d709dcb83064ede219b'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:48.688143 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1177/2365] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:26:48 2022] DELETE /identity/v3/users/fefd3bbf4d084d709dcb83064ede219b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:48.879858 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330deaf-8d0b-47fa-aafb-45c62a9022a9 service placement] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:48.896556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330deaf-8d0b-47fa-aafb-45c62a9022a9 service placement] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:48.958301 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:48.959562 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:48.959746 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:48.960020 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] PATH_INFO: `/v3/projects/05a6a7d18ac64f1ebf28b9fda2ac6ec5` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:48.961197 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a6a7d18ac64f1ebf28b9fda2ac6ec5)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:48.963143 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:49.014800 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a6a7d18ac64f1ebf28b9fda2ac6ec5', 'request_id': 'req-63d86bd7-4772-445d-a047-e34e1c6ff214'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.021936 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a6a7d18ac64f1ebf28b9fda2ac6ec5', 'request_id': 'req-63d86bd7-4772-445d-a047-e34e1c6ff214'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.029195 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a6a7d18ac64f1ebf28b9fda2ac6ec5', 'request_id': 'req-63d86bd7-4772-445d-a047-e34e1c6ff214'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.043987 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] The token cache is being invalidate because project 05a6a7d18ac64f1ebf28b9fda2ac6ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:26:49.044299 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.044920 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.046507 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1189/2366] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:26:48 2022] DELETE /identity/v3/projects/05a6a7d18ac64f1ebf28b9fda2ac6ec5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:26:49.050609 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:49.052110 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:49.060597 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:49.067251 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406aa80-709d-44ab-9cfd-06f3b626910c admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:49.131915 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43855ec-a5c2-4c6a-97d8-849dfe0e710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:49.132588 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43855ec-a5c2-4c6a-97d8-849dfe0e710b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:49.132925 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43855ec-a5c2-4c6a-97d8-849dfe0e710b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:49.133204 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43855ec-a5c2-4c6a-97d8-849dfe0e710b admin admin] PATH_INFO: `/v3/users/623e72f7412143e98bb9ed9004dd0159` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:49.134448 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43855ec-a5c2-4c6a-97d8-849dfe0e710b admin admin] RBAC: Authorizing `identity:delete_user(user_id=623e72f7412143e98bb9ed9004dd0159)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:49.136640 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43855ec-a5c2-4c6a-97d8-849dfe0e710b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:49.190798 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b43855ec-a5c2-4c6a-97d8-849dfe0e710b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623e72f7412143e98bb9ed9004dd0159'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.191924 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b43855ec-a5c2-4c6a-97d8-849dfe0e710b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623e72f7412143e98bb9ed9004dd0159'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.200846 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b43855ec-a5c2-4c6a-97d8-849dfe0e710b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623e72f7412143e98bb9ed9004dd0159'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.213375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b43855ec-a5c2-4c6a-97d8-849dfe0e710b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623e72f7412143e98bb9ed9004dd0159'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.214128 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-b43855ec-a5c2-4c6a-97d8-849dfe0e710b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623e72f7412143e98bb9ed9004dd0159'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.226629 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1178/2367] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:26:49 2022] DELETE /identity/v3/users/623e72f7412143e98bb9ed9004dd0159 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:49.420169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:49.421648 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:49.436199 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d86bd7-4772-445d-a047-e34e1c6ff214 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:49.497043 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:49.497690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:49.497979 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:49.498288 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] PATH_INFO: `/v3/projects/e574cb138e4442058b7ecddac9804742` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:49.499452 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e574cb138e4442058b7ecddac9804742)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:49.501352 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:49.523308 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:49.551044 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e574cb138e4442058b7ecddac9804742', 'request_id': 'req-894aa756-cabb-49a6-8dbe-15a908416d99'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.557940 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e574cb138e4442058b7ecddac9804742', 'request_id': 'req-894aa756-cabb-49a6-8dbe-15a908416d99'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.563757 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e574cb138e4442058b7ecddac9804742', 'request_id': 'req-894aa756-cabb-49a6-8dbe-15a908416d99'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.578492 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] The token cache is being invalidate because project e574cb138e4442058b7ecddac9804742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80184) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:26:49.578677 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.579292 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-894aa756-cabb-49a6-8dbe-15a908416d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:26:49.580812 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1190/2368] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:26:49 2022] DELETE /identity/v3/projects/e574cb138e4442058b7ecddac9804742 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:49.587735 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5d12b-a83f-48dd-928f-17267505566f None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:49.588022 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5d12b-a83f-48dd-928f-17267505566f None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:49.588299 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5d12b-a83f-48dd-928f-17267505566f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:49.609537 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-64f5d12b-a83f-48dd-928f-17267505566f None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:49.610803 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-64f5d12b-a83f-48dd-928f-17267505566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:49.673296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1179/2369] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:26:49.680607 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b917-0928-4701-b412-7f0e2956a763 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:49.680895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b917-0928-4701-b412-7f0e2956a763 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:49.681172 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631b917-0928-4701-b412-7f0e2956a763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:49.702082 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-e631b917-0928-4701-b412-7f0e2956a763 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:49.703321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-e631b917-0928-4701-b412-7f0e2956a763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:49.712370 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1191/2370] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:49.716816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5d12b-a83f-48dd-928f-17267505566f None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:49.729880 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5d12b-a83f-48dd-928f-17267505566f None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:49.731498 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d01345-27b8-44cd-a9ab-5cec61c72662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:49.732115 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d01345-27b8-44cd-a9ab-5cec61c72662 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:49.732394 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d01345-27b8-44cd-a9ab-5cec61c72662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:49.732669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d01345-27b8-44cd-a9ab-5cec61c72662 admin admin] PATH_INFO: `/v3/domains` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:49.733365 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d01345-27b8-44cd-a9ab-5cec61c72662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80183) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:26:49.733671 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d01345-27b8-44cd-a9ab-5cec61c72662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:49.735322 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d01345-27b8-44cd-a9ab-5cec61c72662 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:49.747793 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1180/2371] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:26:49.752356 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631b917-0928-4701-b412-7f0e2956a763 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:49.762995 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631b917-0928-4701-b412-7f0e2956a763 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:49.767763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05d664-b83d-4045-860f-56ac8895db48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:49.768382 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05d664-b83d-4045-860f-56ac8895db48 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:49.768664 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05d664-b83d-4045-860f-56ac8895db48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:49.768946 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05d664-b83d-4045-860f-56ac8895db48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:49.769634 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05d664-b83d-4045-860f-56ac8895db48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:49.771592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05d664-b83d-4045-860f-56ac8895db48 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:49.800758 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1192/2372] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:26:49 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:26:49.805942 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d01345-27b8-44cd-a9ab-5cec61c72662 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:49.816262 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d01345-27b8-44cd-a9ab-5cec61c72662 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:49.821809 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:49.879672 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d40aa-5ae8-45ad-8cd1-4e153330995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:49.880229 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d40aa-5ae8-45ad-8cd1-4e153330995b admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:49.880511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d40aa-5ae8-45ad-8cd1-4e153330995b admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:49.881430 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d40aa-5ae8-45ad-8cd1-4e153330995b admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:49.882211 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d40aa-5ae8-45ad-8cd1-4e153330995b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:49.884219 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d40aa-5ae8-45ad-8cd1-4e153330995b admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:49.906417 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1181/2373] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:26:49 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:26:49.910735 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05d664-b83d-4045-860f-56ac8895db48 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:49.921136 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05d664-b83d-4045-860f-56ac8895db48 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:49.925775 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c4636-7a93-416b-99bc-0efe170255c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:49.926429 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c4636-7a93-416b-99bc-0efe170255c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:49.926714 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c4636-7a93-416b-99bc-0efe170255c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:49.926988 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c4636-7a93-416b-99bc-0efe170255c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:49.928247 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c4636-7a93-416b-99bc-0efe170255c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:49.929885 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c4636-7a93-416b-99bc-0efe170255c2 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:49.940322 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1193/2374] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:26:49.944960 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d40aa-5ae8-45ad-8cd1-4e153330995b admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:49.956201 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d40aa-5ae8-45ad-8cd1-4e153330995b admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:49.960939 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011584c-5ae0-49f1-9ac3-ac4d75e24870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:49.961555 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011584c-5ae0-49f1-9ac3-ac4d75e24870 admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:49.961837 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011584c-5ae0-49f1-9ac3-ac4d75e24870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:49.962150 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011584c-5ae0-49f1-9ac3-ac4d75e24870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:49.962852 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011584c-5ae0-49f1-9ac3-ac4d75e24870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:49.964445 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011584c-5ae0-49f1-9ac3-ac4d75e24870 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:49.975995 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1182/2375] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:26:49.980203 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c4636-7a93-416b-99bc-0efe170255c2 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:49.992018 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c4636-7a93-416b-99bc-0efe170255c2 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:49.996990 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17c22b-eece-49d8-bd3f-ded4845a731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:49.997663 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17c22b-eece-49d8-bd3f-ded4845a731e admin admin] REQUEST_METHOD: `PUT` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:49.997949 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17c22b-eece-49d8-bd3f-ded4845a731e admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:49.998260 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17c22b-eece-49d8-bd3f-ded4845a731e admin admin] PATH_INFO: `/v3/projects/2aaca392ba274943b37d807b9abbd402/users/1d5ccf63452f49c59580f38de046ac05/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:50.015029 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17c22b-eece-49d8-bd3f-ded4845a731e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aaca392ba274943b37d807b9abbd402, user_id=1d5ccf63452f49c59580f38de046ac05, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:50.017689 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17c22b-eece-49d8-bd3f-ded4845a731e admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:50.033977 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1194/2376] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:26:49 2022] PUT /identity/v3/projects/2aaca392ba274943b37d807b9abbd402/users/1d5ccf63452f49c59580f38de046ac05/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:50.039963 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745fb88-f15e-457c-9926-b91f6992b465 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:50.040428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745fb88-f15e-457c-9926-b91f6992b465 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:50.040976 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745fb88-f15e-457c-9926-b91f6992b465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:50.071139 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-2745fb88-f15e-457c-9926-b91f6992b465 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:50.072376 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-2745fb88-f15e-457c-9926-b91f6992b465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:50.151541 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1183/2377] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:50.162703 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17c22b-eece-49d8-bd3f-ded4845a731e admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:50.164433 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-9d17c22b-eece-49d8-bd3f-ded4845a731e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:50.228773 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17c22b-eece-49d8-bd3f-ded4845a731e admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:50.232405 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1477a-ae2c-4bab-ab80-101fa038f419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:50.233019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1477a-ae2c-4bab-ab80-101fa038f419 service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:50.233302 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1477a-ae2c-4bab-ab80-101fa038f419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:50.233573 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1477a-ae2c-4bab-ab80-101fa038f419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:50.243460 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1477a-ae2c-4bab-ab80-101fa038f419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:50.244878 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1477a-ae2c-4bab-ab80-101fa038f419 service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:50.255592 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1195/2378] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:26:54.293151 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747b12-0e4a-47ae-aa6e-9b1019b205de None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:54.293749 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747b12-0e4a-47ae-aa6e-9b1019b205de None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:54.293868 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747b12-0e4a-47ae-aa6e-9b1019b205de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:54.324248 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-45747b12-0e4a-47ae-aa6e-9b1019b205de None None] MFA Rules not processed for user `1d5ccf63452f49c59580f38de046ac05`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:54.325443 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-45747b12-0e4a-47ae-aa6e-9b1019b205de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:54.426635 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1184/2379] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:26:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:54.428245 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1477a-ae2c-4bab-ab80-101fa038f419 service neutron] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:54.439410 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1477a-ae2c-4bab-ab80-101fa038f419 service neutron] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:54.444879 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e4531-f1a8-442d-b31c-2444cb734c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:54.445610 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e4531-f1a8-442d-b31c-2444cb734c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:54.445954 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e4531-f1a8-442d-b31c-2444cb734c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:54.446335 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e4531-f1a8-442d-b31c-2444cb734c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:54.447019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e4531-f1a8-442d-b31c-2444cb734c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:54.449078 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e4531-f1a8-442d-b31c-2444cb734c09 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:54.495083 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1196/2380] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:26:54 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:26:54.499422 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45747b12-0e4a-47ae-aa6e-9b1019b205de None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:54.512231 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45747b12-0e4a-47ae-aa6e-9b1019b205de None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:54.526602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:54.577994 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9c5a-63e3-4656-9426-08c0a3a7ab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:54.578669 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9c5a-63e3-4656-9426-08c0a3a7ab17 admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:54.578952 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9c5a-63e3-4656-9426-08c0a3a7ab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:54.579223 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9c5a-63e3-4656-9426-08c0a3a7ab17 admin admin] PATH_INFO: `/v3/users` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:54.579916 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a9c5a-63e3-4656-9426-08c0a3a7ab17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:54.581821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a9c5a-63e3-4656-9426-08c0a3a7ab17 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:54.607484 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1185/2381] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:26:54 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:26:54.613280 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e4531-f1a8-442d-b31c-2444cb734c09 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:54.625998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e4531-f1a8-442d-b31c-2444cb734c09 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:54.633155 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee1ac-8919-44cf-86d7-afd2fd47d058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:54.634079 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee1ac-8919-44cf-86d7-afd2fd47d058 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:54.634372 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee1ac-8919-44cf-86d7-afd2fd47d058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:54.634647 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ee1ac-8919-44cf-86d7-afd2fd47d058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:54.635363 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ee1ac-8919-44cf-86d7-afd2fd47d058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:54.637267 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ee1ac-8919-44cf-86d7-afd2fd47d058 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:54.650790 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1197/2382] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:26:54.654334 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9c5a-63e3-4656-9426-08c0a3a7ab17 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:54.666745 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9c5a-63e3-4656-9426-08c0a3a7ab17 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:54.671546 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea679a-2f3a-4a0a-9d43-7d35a30372ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:54.672266 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea679a-2f3a-4a0a-9d43-7d35a30372ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:54.672575 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea679a-2f3a-4a0a-9d43-7d35a30372ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:54.672853 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea679a-2f3a-4a0a-9d43-7d35a30372ab admin admin] PATH_INFO: `/v3/projects/15f2ad1e355b4c02a63a305ed4e4e6f2/users/a1b548a1656e4f5f895a946b93ba7607/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:54.690492 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea679a-2f3a-4a0a-9d43-7d35a30372ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f2ad1e355b4c02a63a305ed4e4e6f2, user_id=a1b548a1656e4f5f895a946b93ba7607, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:54.693233 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea679a-2f3a-4a0a-9d43-7d35a30372ab admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:54.708767 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1186/2383] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:26:54 2022] PUT /identity/v3/projects/15f2ad1e355b4c02a63a305ed4e4e6f2/users/a1b548a1656e4f5f895a946b93ba7607/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:54.713009 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee1ac-8919-44cf-86d7-afd2fd47d058 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:54.723869 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ee1ac-8919-44cf-86d7-afd2fd47d058 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:54.734191 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:26:54.790594 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb251a-289e-48ce-be73-f2f917398b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:54.791229 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb251a-289e-48ce-be73-f2f917398b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:54.791724 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb251a-289e-48ce-be73-f2f917398b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:54.792005 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb251a-289e-48ce-be73-f2f917398b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:54.792718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb251a-289e-48ce-be73-f2f917398b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:54.794395 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb251a-289e-48ce-be73-f2f917398b34 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:54.805681 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1198/2384] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 08:26:54.809892 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea679a-2f3a-4a0a-9d43-7d35a30372ab admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:54.821695 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea679a-2f3a-4a0a-9d43-7d35a30372ab admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:54.826601 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd9c7b-e996-4c79-8b47-d174c7b03a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:54.827286 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd9c7b-e996-4c79-8b47-d174c7b03a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:54.827563 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd9c7b-e996-4c79-8b47-d174c7b03a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:54.827978 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd9c7b-e996-4c79-8b47-d174c7b03a75 admin admin] PATH_INFO: `/v3/projects/15f2ad1e355b4c02a63a305ed4e4e6f2/users/a1b548a1656e4f5f895a946b93ba7607/roles/833033b33b864ee4acbf46f69ad82dc3` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:54.830142 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd9c7b-e996-4c79-8b47-d174c7b03a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f2ad1e355b4c02a63a305ed4e4e6f2, user_id=a1b548a1656e4f5f895a946b93ba7607, role_id=833033b33b864ee4acbf46f69ad82dc3)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:54.832787 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd9c7b-e996-4c79-8b47-d174c7b03a75 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:54.845202 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1187/2385] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:26:54 2022] PUT /identity/v3/projects/15f2ad1e355b4c02a63a305ed4e4e6f2/users/a1b548a1656e4f5f895a946b93ba7607/roles/833033b33b864ee4acbf46f69ad82dc3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:26:57.911031 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e2d86-91c9-467d-a7f7-22a84a7da6f4 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:57.912530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e2d86-91c9-467d-a7f7-22a84a7da6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:57.913019 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e2d86-91c9-467d-a7f7-22a84a7da6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:57.944252 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d01e2d86-91c9-467d-a7f7-22a84a7da6f4 None None] MFA Rules not processed for user `ad48c627d5d142489f40584eea36a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:26:57.946909 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d01e2d86-91c9-467d-a7f7-22a84a7da6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:58.071115 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1199/2386] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:26:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:26:58.158688 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd9c7b-e996-4c79-8b47-d174c7b03a75 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:26:58.161357 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-77bd9c7b-e996-4c79-8b47-d174c7b03a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:26:58.282497 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd9c7b-e996-4c79-8b47-d174c7b03a75 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:26:58.299297 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194886a-5b22-4f55-81fd-dbc8faae998b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02b653d2f5e4faca2906b2fbd1bfc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:26:58.299956 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194886a-5b22-4f55-81fd-dbc8faae998b service swift] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:26:58.300230 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194886a-5b22-4f55-81fd-dbc8faae998b service swift] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:26:58.300508 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194886a-5b22-4f55-81fd-dbc8faae998b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:26:58.320016 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194886a-5b22-4f55-81fd-dbc8faae998b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:26:58.321816 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194886a-5b22-4f55-81fd-dbc8faae998b service swift] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:26:58.337846 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1188/2387] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 08:26:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:27:00.270050 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6f058-66b0-4e5d-948d-dc9f84702daf None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:00.270721 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6f058-66b0-4e5d-948d-dc9f84702daf None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:00.270828 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6f058-66b0-4e5d-948d-dc9f84702daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:00.331459 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-ded6f058-66b0-4e5d-948d-dc9f84702daf None None] MFA Rules not processed for user `a1b548a1656e4f5f895a946b93ba7607`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:27:00.332179 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ded6f058-66b0-4e5d-948d-dc9f84702daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:00.444690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1200/2388] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:27:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:27:00.460918 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194886a-5b22-4f55-81fd-dbc8faae998b service swift] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:00.466757 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-7194886a-5b22-4f55-81fd-dbc8faae998b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:00.692004 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:27:00.732393 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194886a-5b22-4f55-81fd-dbc8faae998b service swift] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:00.738817 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd7a3-0c0b-4166-84ba-62a8835f5a58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '739b8f31f1d74459a7348c3ed699812c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:00.739723 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd7a3-0c0b-4166-84ba-62a8835f5a58 service glance] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:00.740187 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd7a3-0c0b-4166-84ba-62a8835f5a58 service glance] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:00.740476 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd7a3-0c0b-4166-84ba-62a8835f5a58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:00.870414 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fd7a3-0c0b-4166-84ba-62a8835f5a58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:00.872001 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fd7a3-0c0b-4166-84ba-62a8835f5a58 service glance] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:00.892454 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1189/2389] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:27:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:27:01.088150 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94101efb-ffe2-4cd3-9189-e4e912b11ab6 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:01.088647 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94101efb-ffe2-4cd3-9189-e4e912b11ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:01.089104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94101efb-ffe2-4cd3-9189-e4e912b11ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:01.119824 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-94101efb-ffe2-4cd3-9189-e4e912b11ab6 None None] MFA Rules not processed for user `ad48c627d5d142489f40584eea36a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:27:01.121172 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-94101efb-ffe2-4cd3-9189-e4e912b11ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:01.138436 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1201/2390] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:27:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:27:01.156025 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd7a3-0c0b-4166-84ba-62a8835f5a58 service glance] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:01.171501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd7a3-0c0b-4166-84ba-62a8835f5a58 service glance] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:01.180105 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ae9a6-13b0-4289-a75b-76168825292c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02b653d2f5e4faca2906b2fbd1bfc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:01.181324 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ae9a6-13b0-4289-a75b-76168825292c service swift] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:01.181869 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ae9a6-13b0-4289-a75b-76168825292c service swift] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:01.182276 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ae9a6-13b0-4289-a75b-76168825292c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:01.195305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ae9a6-13b0-4289-a75b-76168825292c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:01.198778 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ae9a6-13b0-4289-a75b-76168825292c service swift] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:01.212898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1190/2391] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 08:27:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:27:04.851033 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda4d1-27e6-4246-a859-dcb23be58efb None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:04.851559 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda4d1-27e6-4246-a859-dcb23be58efb None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:04.852353 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eda4d1-27e6-4246-a859-dcb23be58efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:04.878804 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d8eda4d1-27e6-4246-a859-dcb23be58efb None None] MFA Rules not processed for user `cfa2bc7fc2964af7929d0ebe7e745015`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:27:04.880779 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d8eda4d1-27e6-4246-a859-dcb23be58efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:04.948337 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=100 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:27:05.023346 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1202/2392] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:27:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:27:11.207620 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=36 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:27:12.499770 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a139-ceae-464e-8728-65139a003b2c None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:12.501243 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a139-ceae-464e-8728-65139a003b2c None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:12.501702 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5a139-ceae-464e-8728-65139a003b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:12.526861 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-e5c5a139-ceae-464e-8728-65139a003b2c None None] MFA Rules not processed for user `1d5ccf63452f49c59580f38de046ac05`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:27:12.528418 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-e5c5a139-ceae-464e-8728-65139a003b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:12.537377 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1191/2393] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:27:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:27:15.005550 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=10 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:27:15.761849 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef801a2d-2263-45c6-be3b-c98930ace503 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:15.763616 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef801a2d-2263-45c6-be3b-c98930ace503 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:15.764490 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef801a2d-2263-45c6-be3b-c98930ace503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:15.815135 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-ef801a2d-2263-45c6-be3b-c98930ace503 None None] MFA Rules not processed for user `ad48c627d5d142489f40584eea36a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:27:15.820321 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ef801a2d-2263-45c6-be3b-c98930ace503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:15.847118 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1203/2394] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:27:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:27:15.876353 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5a139-ceae-464e-8728-65139a003b2c None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:15.899520 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5a139-ceae-464e-8728-65139a003b2c None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:15.905876 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663f377-f2bf-4d94-b6e0-5774cc0105f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02b653d2f5e4faca2906b2fbd1bfc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:15.906567 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f377-f2bf-4d94-b6e0-5774cc0105f9 service swift] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:15.906847 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f377-f2bf-4d94-b6e0-5774cc0105f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:15.907118 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663f377-f2bf-4d94-b6e0-5774cc0105f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:15.930326 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663f377-f2bf-4d94-b6e0-5774cc0105f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:15.933502 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663f377-f2bf-4d94-b6e0-5774cc0105f9 service swift] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:15.953055 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1192/2395] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 08:27:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:27:19.546701 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503466aa-08d0-420c-9668-7f61f076fb17 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:19.547299 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503466aa-08d0-420c-9668-7f61f076fb17 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:19.547402 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503466aa-08d0-420c-9668-7f61f076fb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:19.570158 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-503466aa-08d0-420c-9668-7f61f076fb17 None None] MFA Rules not processed for user `ad48c627d5d142489f40584eea36a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:27:19.571401 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-503466aa-08d0-420c-9668-7f61f076fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:19.578566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1204/2396] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 2 08:27:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 08:27:19.591788 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663f377-f2bf-4d94-b6e0-5774cc0105f9 service swift] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:19.604750 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663f377-f2bf-4d94-b6e0-5774cc0105f9 service swift] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:19.615305 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117917e7-22e6-4417-b8de-5abf83414702 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02b653d2f5e4faca2906b2fbd1bfc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:19.615896 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117917e7-22e6-4417-b8de-5abf83414702 service swift] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:19.616173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117917e7-22e6-4417-b8de-5abf83414702 service swift] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:19.616604 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117917e7-22e6-4417-b8de-5abf83414702 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:19.632460 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117917e7-22e6-4417-b8de-5abf83414702 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:19.635786 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117917e7-22e6-4417-b8de-5abf83414702 service swift] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:19.652511 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1193/2397] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 08:27:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:27:21.893765 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503466aa-08d0-420c-9668-7f61f076fb17 None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:21.895856 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-503466aa-08d0-420c-9668-7f61f076fb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:21.979315 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503466aa-08d0-420c-9668-7f61f076fb17 None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:21.983913 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2166-81f9-4b60-8518-f5aeeec60958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:21.984564 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2166-81f9-4b60-8518-f5aeeec60958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:21.984850 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2166-81f9-4b60-8518-f5aeeec60958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:21.985129 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2166-81f9-4b60-8518-f5aeeec60958 admin admin] PATH_INFO: `/v3/users/553e6c84f36e49c7964a593a42122412` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:21.986359 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2166-81f9-4b60-8518-f5aeeec60958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=553e6c84f36e49c7964a593a42122412)` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:21.988316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e2166-81f9-4b60-8518-f5aeeec60958 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:22.057895 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-163e2166-81f9-4b60-8518-f5aeeec60958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553e6c84f36e49c7964a593a42122412'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:27:22.065338 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-163e2166-81f9-4b60-8518-f5aeeec60958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553e6c84f36e49c7964a593a42122412'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:27:22.073998 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-163e2166-81f9-4b60-8518-f5aeeec60958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553e6c84f36e49c7964a593a42122412'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:27:22.074707 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-163e2166-81f9-4b60-8518-f5aeeec60958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553e6c84f36e49c7964a593a42122412'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:27:22.088047 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.notifications [None req-163e2166-81f9-4b60-8518-f5aeeec60958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553e6c84f36e49c7964a593a42122412'} {{(pid=80184) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:27:22.095068 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1205/2398] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 08:27:21 2022] DELETE /identity/v3/users/553e6c84f36e49c7964a593a42122412 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 08:27:22.320336 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117917e7-22e6-4417-b8de-5abf83414702 service swift] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:22.344821 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117917e7-22e6-4417-b8de-5abf83414702 service swift] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:22.441190 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:22.446839 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:22.447175 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:22.447466 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] PATH_INFO: `/v3/projects/84f98d445efa48eaa0599ed734ef0c47` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:22.450811 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f98d445efa48eaa0599ed734ef0c47)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:22.452763 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:22.515475 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f98d445efa48eaa0599ed734ef0c47', 'request_id': 'req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:27:22.523528 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f98d445efa48eaa0599ed734ef0c47', 'request_id': 'req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:27:22.529836 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f98d445efa48eaa0599ed734ef0c47', 'request_id': 'req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8'} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:27:22.544320 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] The token cache is being invalidate because project 84f98d445efa48eaa0599ed734ef0c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80183) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 08:27:22.544616 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:27:22.545271 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.notifications [None req-20b4a5bc-d2f3-4486-9ab4-6f57976e09a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80183) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 08:27:22.547167 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1194/2399] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 08:27:22 2022] DELETE /identity/v3/projects/84f98d445efa48eaa0599ed734ef0c47 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:27:22.552660 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf29333-85c5-4dd3-90ac-a557ea4ee3ab None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:22.552976 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf29333-85c5-4dd3-90ac-a557ea4ee3ab None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:22.553284 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf29333-85c5-4dd3-90ac-a557ea4ee3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:22.574815 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-ccf29333-85c5-4dd3-90ac-a557ea4ee3ab None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:27:22.575964 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-ccf29333-85c5-4dd3-90ac-a557ea4ee3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:22.639556 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1206/2400] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:27:22.648244 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26bde-f840-4888-b48a-1996a0fb16b5 None None] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:22.648619 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26bde-f840-4888-b48a-1996a0fb16b5 None None] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:22.648898 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26bde-f840-4888-b48a-1996a0fb16b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:22.676625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.auth.core [None req-5eb26bde-f840-4888-b48a-1996a0fb16b5 None None] MFA Rules not processed for user `48e73f0688f64fae87f2adc4e4e25455`. Rule list: `[]` (Enabled: `True`). {{(pid=80183) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:27:22.676625 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-5eb26bde-f840-4888-b48a-1996a0fb16b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:22.688173 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1195/2401] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:27:22.689474 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf29333-85c5-4dd3-90ac-a557ea4ee3ab None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:22.703572 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf29333-85c5-4dd3-90ac-a557ea4ee3ab None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:22.710432 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84b13c-5137-4367-ab5b-a4ea320571e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:22.711099 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84b13c-5137-4367-ab5b-a4ea320571e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:22.711566 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84b13c-5137-4367-ab5b-a4ea320571e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:22.712053 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84b13c-5137-4367-ab5b-a4ea320571e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:22.713224 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84b13c-5137-4367-ab5b-a4ea320571e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80184) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 08:27:22.713718 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84b13c-5137-4367-ab5b-a4ea320571e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:22.715404 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84b13c-5137-4367-ab5b-a4ea320571e4 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:22.717355 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:27:22.735496 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1207/2402] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 08:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 08:27:22.740812 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb26bde-f840-4888-b48a-1996a0fb16b5 None None] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:22.750707 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb26bde-f840-4888-b48a-1996a0fb16b5 None None] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:22.755866 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339d6f9-4bbb-4276-9899-5db8c2f0e4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:22.756612 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339d6f9-4bbb-4276-9899-5db8c2f0e4aa admin admin] REQUEST_METHOD: `POST` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:22.756964 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339d6f9-4bbb-4276-9899-5db8c2f0e4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:22.757312 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339d6f9-4bbb-4276-9899-5db8c2f0e4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:22.758079 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339d6f9-4bbb-4276-9899-5db8c2f0e4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:22.760391 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339d6f9-4bbb-4276-9899-5db8c2f0e4aa admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:22.799356 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1196/2403] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 08:27:22 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:27:22.806530 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84b13c-5137-4367-ab5b-a4ea320571e4 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:22.836297 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84b13c-5137-4367-ab5b-a4ea320571e4 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:22.914167 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2c3bf-e3d7-4129-aafd-a5bae89a9ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:22.914771 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2c3bf-e3d7-4129-aafd-a5bae89a9ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:22.915035 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2c3bf-e3d7-4129-aafd-a5bae89a9ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:22.915316 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2c3bf-e3d7-4129-aafd-a5bae89a9ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:22.915980 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2c3bf-e3d7-4129-aafd-a5bae89a9ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:22.920683 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2c3bf-e3d7-4129-aafd-a5bae89a9ee8 admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:22.947120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1208/2404] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 08:27:22 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 08:27:22.951355 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339d6f9-4bbb-4276-9899-5db8c2f0e4aa admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:22.962375 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339d6f9-4bbb-4276-9899-5db8c2f0e4aa admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:22.967304 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a1592-50d9-4ffa-a8d4-f9509e65a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:22.968031 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a1592-50d9-4ffa-a8d4-f9509e65a22f admin admin] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:22.968315 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a1592-50d9-4ffa-a8d4-f9509e65a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:22.968591 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a1592-50d9-4ffa-a8d4-f9509e65a22f admin admin] PATH_INFO: `/v3/roles` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:22.969314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a1592-50d9-4ffa-a8d4-f9509e65a22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:22.970929 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a1592-50d9-4ffa-a8d4-f9509e65a22f admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:22.982349 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1197/2405] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:27:22.986819 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2c3bf-e3d7-4129-aafd-a5bae89a9ee8 admin admin] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:23.000167 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2c3bf-e3d7-4129-aafd-a5bae89a9ee8 admin admin] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:23.005055 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a772abf-ff6c-4f1e-80b5-b14a60b5564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:23.005704 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a772abf-ff6c-4f1e-80b5-b14a60b5564f admin admin] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:23.006187 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a772abf-ff6c-4f1e-80b5-b14a60b5564f admin admin] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:23.006467 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a772abf-ff6c-4f1e-80b5-b14a60b5564f admin admin] PATH_INFO: `/v3/roles` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:23.007169 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a772abf-ff6c-4f1e-80b5-b14a60b5564f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:23.018194 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a772abf-ff6c-4f1e-80b5-b14a60b5564f admin admin] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:23.031545 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1209/2406] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 08:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 08:27:23.037527 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a1592-50d9-4ffa-a8d4-f9509e65a22f admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:23.048017 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a1592-50d9-4ffa-a8d4-f9509e65a22f admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:23.052945 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e2968-ea59-4c29-a61c-7b91e66473b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48e73f0688f64fae87f2adc4e4e25455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '255cf96e6d4c4f0180d3f193cc9e8b40', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:23.053602 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2968-ea59-4c29-a61c-7b91e66473b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:23.053889 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2968-ea59-4c29-a61c-7b91e66473b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:23.054226 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2968-ea59-4c29-a61c-7b91e66473b0 admin admin] PATH_INFO: `/v3/projects/df8d9856e0814ac48b6599c71ffa761f/users/cc16a72e6dc3428c842a15445a266dc3/roles/a4aae8b3b8b4486389006b0d25566eb6` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:23.069636 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e2968-ea59-4c29-a61c-7b91e66473b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8d9856e0814ac48b6599c71ffa761f, user_id=cc16a72e6dc3428c842a15445a266dc3, role_id=a4aae8b3b8b4486389006b0d25566eb6)` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:23.072314 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e2968-ea59-4c29-a61c-7b91e66473b0 admin admin] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:23.074756 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:27:23.093439 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1198/2407] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 08:27:23 2022] PUT /identity/v3/projects/df8d9856e0814ac48b6599c71ffa761f/users/cc16a72e6dc3428c842a15445a266dc3/roles/a4aae8b3b8b4486389006b0d25566eb6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 08:27:23.104374 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f40cb-20ff-4290-9c89-cf70ff9fdf74 None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:23.104656 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f40cb-20ff-4290-9c89-cf70ff9fdf74 None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:23.104930 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058f40cb-20ff-4290-9c89-cf70ff9fdf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:23.132842 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-058f40cb-20ff-4290-9c89-cf70ff9fdf74 None None] MFA Rules not processed for user `cc16a72e6dc3428c842a15445a266dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:27:23.134120 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-058f40cb-20ff-4290-9c89-cf70ff9fdf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:23.212872 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1210/2408] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 08:27:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:27:23.223807 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e2968-ea59-4c29-a61c-7b91e66473b0 admin admin] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:27:23.225509 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-808e2968-ea59-4c29-a61c-7b91e66473b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:27:23.288870 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e2968-ea59-4c29-a61c-7b91e66473b0 admin admin] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:27:23.292531 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf6c66-bc3d-448c-a5cd-fa6b531fa8c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6557be84abb6469d95157570517512fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:27:23.293149 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf6c66-bc3d-448c-a5cd-fa6b531fa8c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:27:23.293428 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf6c66-bc3d-448c-a5cd-fa6b531fa8c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:27:23.293801 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf6c66-bc3d-448c-a5cd-fa6b531fa8c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:27:23.302409 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf6c66-bc3d-448c-a5cd-fa6b531fa8c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:27:23.303827 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf6c66-bc3d-448c-a5cd-fa6b531fa8c2 service cinder] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:27:23.312452 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1199/2409] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:27:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:27:33.208763 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:27:33.308532 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:28:17.840690 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953391e-fbfa-494b-8a30-164b78a9c0ca None None] REQUEST_METHOD: `POST` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:28:17.841216 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953391e-fbfa-494b-8a30-164b78a9c0ca None None] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:28:17.841310 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953391e-fbfa-494b-8a30-164b78a9c0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:28:17.862797 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.auth.core [None req-d953391e-fbfa-494b-8a30-164b78a9c0ca None None] MFA Rules not processed for user `ad48c627d5d142489f40584eea36a17f`. Rule list: `[]` (Enabled: `True`). {{(pid=80184) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 08:28:17.864074 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d953391e-fbfa-494b-8a30-164b78a9c0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:28:17.921680 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1211/2410] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 08:28:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 08:28:17.945996 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf6c66-bc3d-448c-a5cd-fa6b531fa8c2 service cinder] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:28:17.947463 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-edcf6c66-bc3d-448c-a5cd-fa6b531fa8c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:28:18.026558 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf6c66-bc3d-448c-a5cd-fa6b531fa8c2 service cinder] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:28:18.031501 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01194893-995d-481c-ba3b-12281cac2f08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02b653d2f5e4faca2906b2fbd1bfc5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:28:18.032126 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01194893-995d-481c-ba3b-12281cac2f08 service swift] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:28:18.032406 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01194893-995d-481c-ba3b-12281cac2f08 service swift] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:28:18.032688 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01194893-995d-481c-ba3b-12281cac2f08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:28:18.041579 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01194893-995d-481c-ba3b-12281cac2f08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:28:18.043214 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01194893-995d-481c-ba3b-12281cac2f08 service swift] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:28:18.052565 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1200/2411] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 08:28:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 08:28:27.914769 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=25 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:28:28.048704 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=32 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:29:33.253654 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953391e-fbfa-494b-8a30-164b78a9c0ca None None] Authenticating user token {{(pid=80184) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:29:33.255117 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-d953391e-fbfa-494b-8a30-164b78a9c0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:29:33.313409 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953391e-fbfa-494b-8a30-164b78a9c0ca None None] Validating token access rules against request {{(pid=80184) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:29:33.316994 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714ea44-f3e8-4626-abeb-4a0fd93a8b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e68c134016414ea5b851bde233ed9951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80184) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:29:33.317618 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714ea44-f3e8-4626-abeb-4a0fd93a8b5b service neutron] REQUEST_METHOD: `GET` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:29:33.317901 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714ea44-f3e8-4626-abeb-4a0fd93a8b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:29:33.318207 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714ea44-f3e8-4626-abeb-4a0fd93a8b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80184) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:29:33.320000 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.fernet_utils [None req-a714ea44-f3e8-4626-abeb-4a0fd93a8b5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80184) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:29:33.330673 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714ea44-f3e8-4626-abeb-4a0fd93a8b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:29:33.332104 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714ea44-f3e8-4626-abeb-4a0fd93a8b5b service neutron] RBAC: Authorization granted {{(pid=80184) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:29:33.341251 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: [pid: 80184|app: 0|req: 1212/2412] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:29:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:29:43.336890 dv-cinder-850318-5-iscsi devstack@keystone.service[80184]: DEBUG dbcounter [-] [80184] Writing DB stats keystone:SELECT=26 {{(pid=80184) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 08:32:35.486164 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01194893-995d-481c-ba3b-12281cac2f08 service swift] Authenticating user token {{(pid=80183) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 08:32:35.487721 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-01194893-995d-481c-ba3b-12281cac2f08 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:32:35.638038 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01194893-995d-481c-ba3b-12281cac2f08 service swift] Validating token access rules against request {{(pid=80183) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 08:32:35.643386 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f05d6-6692-4dfa-842c-0f13ddd6a7c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3318842c46ec4c6d9b7b1f55c9fab62b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4bf48158ec549ecb880530a3b4ff229', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80183) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 08:32:35.644014 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f05d6-6692-4dfa-842c-0f13ddd6a7c2 service placement] REQUEST_METHOD: `GET` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 08:32:35.644296 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f05d6-6692-4dfa-842c-0f13ddd6a7c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 08:32:35.644573 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f05d6-6692-4dfa-842c-0f13ddd6a7c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80183) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 08:32:35.646411 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.fernet_utils [None req-533f05d6-6692-4dfa-842c-0f13ddd6a7c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80183) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 08:32:35.658581 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f05d6-6692-4dfa-842c-0f13ddd6a7c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 08:32:35.660157 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f05d6-6692-4dfa-842c-0f13ddd6a7c2 service placement] RBAC: Authorization granted {{(pid=80183) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 08:32:35.669810 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: [pid: 80183|app: 0|req: 1201/2413] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 08:32:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 08:32:45.665662 dv-cinder-850318-5-iscsi devstack@keystone.service[80183]: DEBUG dbcounter [-] [80183] Writing DB stats keystone:SELECT=63 {{(pid=80183) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}